Data Engineer - Aspiring Data Architect
We are currently looking for a new Data Engineer to join a great software and hardware company within their Cardiff office (currently working remotely).
This is a brand new role which has been created, you will remote into the head of the architecture team and work alongside them, a data scientist and the rest of the business to help create a new data analysis product for their customers. This role will be 75% hands on and 25% architecture to begin with. We need you to come in and asses the current state of the data situation, then make the changes that need to be made for this new product to start taking shape.
This is the type of company where every employee is valued and not just a number. You will be given respect and the voice to do what you think is best for your area of expertise. However although you will be hired as an expert in your field, this is the kind of business where very often you will need to go outside of your remit to get the job done and where multiple hats at sometimes.
Interact with several key roles in the company including other System Architects, Product Managers, developers, test teams and other delivery functions.
Develops and maintains data infrastructure and pipelines. Balance the "here and now" application requirements against the strategic architecture directions set out by lead system architect.
Owning the data manipulation and processing within the key systems such as Spark
Responsible for recommending the schemas and architecture processes to move data between our systems (software product and Data Analytics)
Managing and recommending new products that allow the MDA product forward from a data architecture perspective and support the Data Scientist in the Analytics functionality
Help shape the core architecture from the data integration perspective. This will involve working closely with the other architects to understand any overlap in technologies and the introduction of new tools and processes to achieve our goal.
Deep and broad technical knowledge of software architecture and generic understanding of high-level architecture principles
Experience of working as part of a wider architecture team and awareness of the different layers of architecture
Strong experience in the ability to compose a large number of technical documentation, reports and diagrams.
Ability to assess effort, risk, costs and complexity for software solutions
Good communication skills with the ability to relate to various audiences
Experience developing big data systems: Hadoop, Spark, Kafka, etc.
Experience at analysing data with R and Python as well as conducting big data analyses.
Geospatial analysis experience would be useful
Experience with data visualisation tools, such as Tableau, Power BI etc.
Experience with AWS is desirable.
Experience with machine learning is desirable.
Good applied statistics skills, such as distributions, statistical testing, regression, etc.
Data-oriented personality with a positive, can do attitude
If you are interested in this role please send in your most relevant and up to date CV ASAP to apply.
To find out more about Computer Futures please visit www.computerfutures.com
Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Agency in relation to this vacancy | Registered office | 1st Floor, 75 King William Street, London, EC4N 7BE, United Kingdom | Partnership Number | OC387148 England and Wales