Senior Data Engineer (Chantilly OR Herndon, VA) Job at Edgesource, Washington DC

Ly90bXBHRVljdFdrek1xL3Jhb2pMQjZOVWc9PQ==
  • Edgesource
  • Washington DC

Job Description

Company Overview:
For over 25 years, Edgesource Corporation has served as an innovative technology service provider for the Department of Defense (DOD), Department of Homeland Security (DHS), Department of State (DOS), the U.S. Intelligence Community, Law Enforcement, and other federal, state, and commercial clients locally, nationally, and abroad. From providing boutique technical solutions in support of the DOD Counter Unmanned Aerial Systems (CUAS) mission set to addressing the most critical Cybersecurity threats facing our nation as a prime contractor with the DHS Cybersecurity & Infrastructure Security Agency (CISA), a career at Edgesource is an opportunity to do meaningful, interesting, and impactful work.

Position Overview:
Edgesource is actively seeking a  Senior Data Engineer to support the development of new tools, code, and services to execute data engineering activities involving data of varying types and in varying conditions. Job duties are performed 100% onsite at either the customer location in Chantilly or Herndon, VA.

Job Duties:

  • Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers
  • Ensure the pedigree and provenance of the data is maintained such that the access to data is protected
  • Clean and preprocess data to enable access for advanced analytics
  • Collaborate with enterprise working groups to advance the state of data standards
  • Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings
  • Collaborate with software engineers to update, configure, and maintain data services based on the requirements
  • Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines
  • Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms
  • Movement of structure and unstructured data using approved methods
  • Execution of data ingestion activities for storing data in a local or enterprise level location
  • Develop code to format data that supports exploration
  • Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives
  • Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models
  • Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards
  • Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions


Required Qualifications:

  • Active TS/SCI with polygraph security clearance
  • 10+ years' experience with the following:
    • Data lifecycle engineering
    • Development and maintenance of extract, transform and load (ETL) tools and services
    • Cloud and on-prem data storage and processing solutions
    • Python, SQL, Spark and other data engineering programming
    • COTS and open-source data engineering tools such as ElasticSearch and NiFi
    • Processing data within the Agile Lifecycle


Working at Edgesource:
As an ISO 9001:2015 certified and CMMI Level 3 appraised small business, Edgesource specializes in providing a variety of technical solutions to include software development, database services, enterprise networking, data center virtualization, and management support. We are always seeking top-talent to join our team in helping to address the most critical technical challenges facing our nation.

At Edgesource, we understand that our employees are our greatest asset, and as such we offer a wide array of benefits to support the well-being of our staff to include:

- Flexible PTO Policy + 11 Paid Holidays -
- Flexible Work Schedules (Remote / Hybrid) -
- Medical / Dental / Vision / Flexible Spending Account (FSA) -
- 401k Plan with Match -
- Tuition & Professional Development Support -
- Commuter Benefits -
- Bonus & Employee Referral Programs -
- Career Growth Opportunities -

Disclaimer:
Edgesource Corporation is an affirmative action and equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. Edgesource is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation, please contact our Recruiting Department by email at  recruiting@edgesource.com or by phone at (703) 837-0550.

 

#CJ

Job Tags

Full time, For contractors, Local area, Remote work, Flexible hours,

Similar Jobs

ProSidian Consulting, LLC

Environmental Compliance and Oversight Specialist [DOE0109108] Job at ProSidian Consulting, LLC

 ...\n\nCompany Description ProSidian is a Management and Operations Consulting Services Firm...  ...Pharmaceuticals, Banking & Financial Services, Transportation, Federal and State Government Agencies....  ...Task Category 05 Assistant Manager for Safety, Environment, & Quality (AMSE/AMSQ)... 

Vituity in

Advanced Provider - Emergency Medicine - St. John's Regional Medical Center Job at Vituity in

 ...Advanced Provider - Emergency Medicine - St. John's Regional Medical Center (Healthcare) Oxnard, CA - Seeking Emergency Medicine Advanced...  ...Current CA state license is a plus. The Practice - A Dual-Hospital System St. John's Regional Medical Center - Oxnard,... 

West Gray Properties LLC

Emergency Room Physician Job at West Gray Properties LLC

 ...Job Title: Emergency Room Physician Key Responsibilities: # Patient Assessment: Evaluate patients' conditions through physical...  ...on current medical practices and developments in emergency medicine. Qualifications: Education: Doctor of Medicine (MD) or... 

ThinkTek

Industrial Security Support Researcher (ISSR) Job at ThinkTek

 ...Job Description Job Description Industrial Security Support Researcher (ISSR) Clearance: Active Top Secret (TS) Who We Are: ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB) company. We specialize in... 

Insight Global

Safeway-Albertsons Immunizer Job at Insight Global

Job Description Job Description Position : Flu Clinic Immunizer Locations : 41 locations across Oregon (35 cities, including Portland, Salem, Eugene, and Medford) and Washington (6 cities, including Vancouver and Walla Walla). Schedule: Part-time and full-...