Skip Navigation
The health and safety of our employees and candidates is very important to us. Due to the current situation related to the Novel Coronavirus (COVID-19), we’re leveraging our digital capabilities to ensure we can continue to recruit top talent at LPL Financial.As your application progresses, you may be asked to use one of our digital tools to help you through your recruitment journey. If so, one of our recruiters will explain what type of interviewing technology will be used throughout the recruitment process and will be on hand to answer any questions that you have. You can also email us at
Search LPL Jobs

Search LPL Jobs

View All Current Opportunities at LPL Financial

AVP Big Data Lead

Job ID: R-014702 Date posted: 06/18/2021 Primary Location TX-Austin Other Locations SC-Fort Mill , CA-San Diego

Are you a team player? Are you curious to learn? Are you interested in working in meaningful projects? Do you want to work with cutting-edge technology? Are you interested in being part of a team that is working to transform and do things differently? If so, LPL Financial is the place for you!

Excited to learn more? If so, then this could be the role for you!  

LPL Financial is one of the nation's leading financial services companies and a publicly traded company under ticker symbol LPLA.  We support over 18,000 financial professionals—including over 14,000 independent advisors, more than 700 financial institutions, and over 4,000 institutional clearing and technology subscribers. We enable advisors to focus on their clients by reducing the complexity of running their practice and we support their business by offering enabling technology, comprehensive clearing and compliance services, practice management programs and training, and independent research. At LPL, we take care of our advisors, so they can take care of their clients. And Technology is at the center of our mission.

Job Overview:

We are currently looking to hire an AVP Big Data Lead within the Enterprise Data and Information Services team, which is part of LPL’s Technology organization. This position is responsible for leading a team to deliver data integration projects across a wide variety of systems in support of business functions and processes to improve advisor


  • Lead development of data integrations on AWS platform using native services
  • Create software design documents in partnership with Enterprise Architecture, Infrastructure, and Information Security teams to ensure alignment
  • Adhere to industry standards and methodologies for software development
  • Train and provide feedback to team members on standards, design patterns, architectural patterns and frameworks for services and integrations
  • Collaborate with analysts, modelers and subject matter experts in domain and data modeling
  • Understand and support metadata management and information science practices that unlocks data as an asset for the firm and improves its usability through its lifecycle
  • Maintain technical documentation that facilitate understanding, maintaining, reusing and refactoring of code

What are we looking for?

We want strong collaborators who can deliver a world-class client experience. We are looking for people who thrive in a fast-paced environment, are client-focused, team oriented, and are able to execute in a way that encourages creativity and continuous improvement.


  • 10 years of experience in IT related software development or support
  • 6-8 years’ experience in design and development of Python or Scala and Spark Application
  • Expert knowledge with key AWS Services, including API Gateway, Lambda, Kafka, EMR, S3, Dynamo, RedShift
  • Expert knowledge in Spark processing using Scala and Python Experience with Distributed SQL Query Engine for Big Data like Apache Drill, Presto, or Hive
  • Experience with storage formats like parquet files, OCR, No-SQL databases
  • Experience with streaming data frameworks and tools (Kafka, StreamSets, Kinesis)
  • Bachelor’s degree


  • Knowledgeable of Enterprise Data Lake patterns
  • Experience with development against relational database (ex: Microsoft SQL Server, PostgreSQL)
  • Experience with DevOps toolchain that enables CI/CD pipeline (e.g., Git, TFS, Jenkins, TeamCity, Octopus, Puppet)
  • Experience with creation of metadata management artifacts such as data dictionary, business glossary, data flow map, data lineage diagram or ontologies
  • Experience with design and development of services with high performance and scalability
  • Experience with design, implementation and adoption of container tech stack (e.g., Docker, Kubernetes)
  • Experience with development against non-relational database (e.g., key-value store, columnar store, graph database)
  • Experience with any ETL tool (Informatica, DataSatge, Sqoop, etc.) is preferred

Core Competencies:

  • Strong problem-solving skills (e.g., root cause analysis) to debug or improve existing systems
  • Strong project leadership skills to manage Agile team to deliver product features

Why LPL? 

At LPL, we believe that objective financial guidance is a fundamental need for everyone. As the nation’s leading independent broker-dealer, we offer an integrated platform of proprietary technology, brokerage, and investment advisor services. We provide you with a work environment that encourages your creativity and growth, a leadership team that is supportive and responsive, and the opportunity to create a career that has no limits, only amazing potential.

We are one team on one mission. We take care of our advisors, so they can take care of their clients.

Because our company is not too big and not too small, you can seize the opportunity to make a real impact. We are committed to supporting workplace equality, and we embrace the different perspectives and backgrounds of our employees.We also care for our communities, and we encourage our employees to do the same. This creates an environment in which you can do your best work.

Want to hear from our employees on what it’s like to work at LPL?  Watch this!

We take social responsibility seriously. Learn more here

Want to see info on our benefits?  Learn more here

Join the LPL team and help us make a difference by turning life’s aspirations into financial realities. Please log in or create an account to apply to this position. Principals only. EOE.

Information on Interviews:

LPL will only communicate with a job applicant directly from an email address and will never conduct an interview online or in a chatroom forum.  During an interview, LPL will not request any form of payment from the applicant, or information regarding an applicant’s bank or credit card.  Should you have any questions regarding the application process, please contact LPL’s Human Resources Solutions Center at (800) 877-7210.

Sign Up for LPL's Talent Community

If you’d like to receive recruiter outreach, news and information from LPL Financial, as well as details on current opportunities that match your preferences and interests, please sign up below.

Area(s) of InterestSelect a job category from the list of options. Search for a location and select one from the list of suggestions. Finally, click “Add” to create your job alert.

  • Information Technology, Austin, Texas, United StatesRemove
  • Information Technology, Fort Mill, South Carolina, United StatesRemove
  • Information Technology, San Diego, California, United StatesRemove