PDS Tech Inc Data Engineer III in Menlo Park, California

PDS TECH INC. is seeking Data Engineer for a 6 Month contract in Menlo Park,CA .

Apply proven expertise and build high-performance, scalable data warehouse application • Securely source external data from numerous global partners • Intelligently design data models for optimal storage and retrieval • Deploy inclusive data quality checks to ensure high quality of data • Optimize existing pipelines and implement new ones, maintenance of all domain-related data pipelines • Ownership of the end-to-end data engineering component of the solution • Collaboration with the program’s SMEs, data scientists

About You:

  • Proficiency in LAMP and the Big Data stack environments (Hadoop, MapReduce, Hive)

  • Competence with relational databases ( Oracle, MySQL, Vertica )

  • Experience working with enterprise DE tools (Informatica), & ability to learn in-house DE tolls

  • Coding and scripting experience with Python, Java, PHP, SQL, CLI

  • Understanding of the threading limitations in python and multi-process architecture

  • Developed Etl using python to load data into Oracle/Mysql/Hive

  • Experience with Tuples and other data types like List, and Pandas modules

  • Experience in developing module using Python.

  • Good to have etl experience ( Informatica/datastage etc)

  • Understanding of Software design patterns, SDLC, Test Driven Development (TDD), Continuous Integration and Continuous Delivery Knowledge of relational, structured, semi-structured and unstructured data systems and when to use each type of system

  • Agile development experience.

  • Strong analytical and problem-solving skills

  • Strong communication and collaboration skills

  • BS/MS in Computer Science or related technical field

All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status.