Associate-Python Developer

Job Detail

About The Job:

Key Responsibilities:

Partner with data strategy and sourcing team on data requirements to design data pipelines and delivery structures
Handle bigdata using python, PySpark, and SQL
Create regex patterns for filtering the required data from raw data using python
Mapping and tagging transactions data to relevant of tickers
Collaborate with core engineering team to create central capabilities to process, manage, monitor, and distribute datasets at scale
Apply robust data quality rules to systemically qualify data deliveries and guarantee the integrity of datasets
Engage with technical and non-technical clients as SME on data asset offerings
Gather and analyze information from a variety of sources

Desired Skills and Experience:

2-4 years of experience with data modeling, data warehousing, and building data pipelines
Skilled in Python and SQL
Working knowledge of regular expressions (Regex)
Understanding of Python (Pandas, Numpy included) & SQL – Fetching data, filtering, grouping etc.
Understanding of Excel & its functions – Filter, pivot, lookups etc.
Experience working with FTP, API, S3 and other distribution channels to source data
Experience working with financial and/or alternative data products
Able to generating & understand plots & graphs of resultant data, perform basic QA and explain anomalies.
Familiarity with version control systems such as GIT
Good exposure to cloud-based technologies AWS, Databricks and ETL
Knowledge of Spark/PySpark
Basic understanding of Scraping