Seeking a senior Pyspark Developer with expertise in big data processing , Python and Apache spark particularly within finance domain. Candidate should have a strong experience working with financial instruments, market risk and large scale distributed computing systems.
This role involves developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting .
Key responsibilities
Develop and optimize scalable PySpark-based data pipelines for processing and analyzing large scale financial dataDesign and implement distributed computing solutions for risk modeling , pricing and regulatory complianceEnsure efficient data storage and retrieval using Big DataImplement best practices for spark performance tuning including partition, caching and memory managementMaintain high code quality through testing , CI/CD pipelines and version control (Git, Jenkins)Work on batch processing frameworks for Market risk analyticsQualifications and Skills
Strong experience in software development with experience in PySpark and Big data frameworksStrong proficiency in Python and Pyspark with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc)Experience working in financial markets , risk management and financial instrumentsFamiliarity with market risk concepts including VaR, Greeks, scenario analysis and stress testingHands on experience with Hadoop, SparkProficiency on Git, Jenkins and CI/CD pipelinesExcellent problem solving skills and strong mathematical and analytical mindsetAbility to work in a fast paced financial environment------------------------------------------------------
Job Family Group:
Technology------------------------------------------------------
Job Family:
Applications Development------------------------------------------------------
Time Type:
Full time------------------------------------------------------
Citi is an equal opportunity and affirmative action employer.
Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View the "EEO is the Law" poster. View the EEO is the Law Supplement.
View the EEO Policy Statement.
View the Pay Transparency Posting