Tossoconf

Day-1
1.Problem Statement:
Theekkathir Tamil newspaper dataset for NLP.
2.Methodology:
Load raw data, remove unwanted characters and English words, validate Tamil words, and create a clean dataset.
3.Technologies Used:
Python, Pandas, Regular Expressions, Parquet Files, Tamil Dictionary.
4.Advantages:
Improves Tamil dataset quality, reconstructs words automatically, and reduces manual work.
5.Future Enhancement:
Improve Tamil word detection, increase dictionary size, and support more Tamil datasets.
6.Tamil Dictionary
A Tamil dictionary contains valid Tamil words.
It is used to check whether a word is correct or not.
In this project, we used a Tamil dictionary with 156,000 Tamil words to validate and clean the dataset.

Day-2

1. What is OpenTelemetry

OpenTelemetry is used to monitor and observe applications.

1. Architecture

App A (Java), App B (Python), and App C (Go) send data to OpenTelemetry.

1. Signals
   Logs, Metrics (CPU, Memory, Hardware), Traces, and Profiles.

2. Instrumentation
   Auto Instrumentation (no code changes) and Manual Instrumentation (add OpenTelemetry API in code).

3. Context Propagation
   Shares request information between different services to track the complete requests.