LOG IN
SIGN UP
Canary Wharfian - Online Investment Banking & Finance Community.
Sign In
Forgot password?
Don't have an account?
or
Join Canary Wharfian
By signing up, you agree to our Terms & Conditions and Privacy Policy.
or

Pipeline Engineer

ExperiencedNo visa sponsorship
Shell logo

at Shell

Commodities

Posted 6 days ago

No clicks

**Pipeline Engineer** Design, implement, and maintain data pipelines using Apache Airflow. Manage pipeline infrastructure, ensuring smooth data flow and optimal performance. Key responsibilities include developing data processing scripts, integrating with AWS services (Glue, S3, Redshift), and collaborating with DataOps teams. Minimum of 3 years of experience in a similar role, with expertise in Python, Airflow, AWS, and SQL. Familiarity with Agile methodologies and ETL processes a plus.

Compensation
Not specified

Currency: Not specified

City
Not specified
Country
Netherlands

Full Job Description

Security Check

Verification successful. Waiting for shell.wd3.myworkdayjobs.com to respond
Enable JavaScript and cookies to continue
(function(){window._cf_chl_opt = {cFPWv: 'b',cH: 'KQwKZ6mokInVOwsNshaglj0VtkPzFRMvN.cp7S5Z6pA-1788302534-1.2.1.1-vnL2g1qBdtf4NrjKBQ0C3h_IUgGPKJCm6qBNzmwcVvP4AamNHK.bbv8vb_jZsRt6',cITimeS: '1788302534',cRay: 'a347c9762d494f8d',cTplB: '0',cTplC:1,cTplO:0,cTplV:5,cType: 'managed',cUPMDTk:"/en-GB/ShellCareers/job/Assen/Pipeline-Engineer_R205925-1?__cf_chl_tk=1oIrpahASvpbXKvK5y.F.fv_iq6DjoVsQMahdUTCxX8-1788302534-1.0.1.1-Vfnhz8k00893bvb7Xswj6vcn1XANdv5pRp4q0sa.9Z4",cvId: '3',cZone: 'shell.wd3.myworkdayjobs.com',fa:"/en-GB/ShellCareers/job/Assen/Pipeline-Engineer_R205925-1?__cf_chl_f_tk=1oIrpahASvpbXKvK5y.F.fv_iq6DjoVsQMahdUTCxX8-1788302534-1.0.1.1-Vfnhz8k00893bvb7Xswj6vcn1XANdv5pRp4q0sa.9Z4",md: 'n27_vJERKpF5clkyUixK0R7KbhPHpQQbK5ruq4d15sY-1788302534-1.2.1.1-j3d9nq9aotprnMpjSRVnF7dbSLF.xr66bo0UOd.LiZ8HWzLOD.5MhPr8izZ9EoiS9CVQyD7lVpXdcK.k3Pg_LM8xY47Hj5iBCd2JB8wSzOYVd5Lonno_n2KsV8DoCw5nIe1oNxCe8yRr_NJiBlt80POqIFTTd25rzZrnXePk5t1EQsoY_pGI460RYjcc6R3w7jo63NLawKlsuuv0LVXaPrndf5wiFC9L4fNl9LUpKbaqTOg8DNpr1vINnouJb7dHhbQd_HqEg32Qk.1ViR92Wb_oqnmLejaPnz6H9ZBNm9BlNLF9YqzzuvAmutuASiM8yQnnHqod7dHTKwoYqh33aCBYwPAyoxeoKey9vULL78WdB2LnaSyLDSIwsNNudjM0hTumBR.vFirNZ9F6hZ34P.sjh3cDWWTWO.jPMfPeblgf.Tea83BmM1D3kuLMmhU0TvDKBk5BBGf.uo.Ovt_JbiZ0D5JAVWTtQ7jiavxqY_IAeBS8OQ3auvzGC4JHyqAGHe_WPkzNgMggo8lVncXE3uKP_tp5ODJCZdjhIPUlWGKRekXybK15sZrsKvlcnlz7CJNbivH2MMbzPxlJIUEFk2muGEPmA5sB7wx7mXfBQd_phrSxbPpIJ_9dLHTX3fCgIzSe5VMrd4bHhcwGr1Z9FEzIsUD2vGwSMigfO61Q201j3wH4nzgnR.NmUoUl6KzXMRIZigmhr_qeGYIh0XnB1Pa18UgzR0NlYQYcsn2JxhJX1uaEnDg1WTXE9lkV3.84olC_Q8Cp4Gv.nCUNBxN9y09EBlu_pi5FPIDAmQUCzMGw97hKhLXougjtvAAlph6Lz07Hri9oR6iEt7YpbfTF45WEdTZTBsnLBSEqeDYZSh17_rvXRWBpEK_XH_roOhaXSZaKJuFrr3p8HC76S_Li.s0eBAIp3s78YCXf_nSUI3FGNSnPhQ0TBZAAq81vRxwOd4rqfI.5AWtKdVxtowh6uBAXcR_m65rpiCz.Yt.iQvgsG7lJwbz9kAMhGzHa288xlAjKoL3MGQ9XsPghO0Zj63S9.v2FHaA3xJunaz6caOtHjldOpXoLe4DHhDB0CZWrAS3ovKqAGfjJxTLY_OCBLS8sXrisW7thFtIDGZ6tum2UuAkpvFQQyPuifO5nyOtLx9ikhdknvtb1_RakS0cDQMZb1vUiozBWw82Yj1LdHpkjaPNRO_v1u8MN8vEmy13gNWBX6dpidVfHbn1s3GYKUf5YLkS1ioxbGWRnnYOz_1qYA0M6yKP_Xgce43kbM.Lx9KGAXVnJszchPl3khTE8lAkHeX52DxtFwNAU92H7Asc',mdrd: 'w31Yx50Bvf1gzxa9U2lL0QLJY922RD2GJ9ny0_s7YI0-1788302534-1.2.1.1-IW6NeH_WiszO8CvWO5QZFY7CkkPDjHkAiq0dXc6MgQMqncUaQGlJTtXW6T2DGUTgCoQmcoytxi9Bk7qGOUyZFq6Dfuilt.Cu_jrzUxr6BS5khAA2dLstlGks_fgRAIhXbCBPgVexlCBl0qAjPSpgG1lnocOuXQEERk7Qy7.yDDKxfX_xjRd9U4q_CHt.HgM4RZlLjjoXZLn3MBQbD_Ea3jYKnMJKo8zEz4fDmNRkWwr6ht5rkKBnvh_WQLu_nHmqi5s6uVi4BWpYzj_kkyJPYVL6YXfzy_WiF8gHOpToT5Dblj5XF6WcXy7h_jRx2X.4iNJWGGbZIfm_LAHLBfWmjhE2NpHNAemeheuBYXP7RkvzTONqRD4G6jbAmUXjMPN93i.HbB_x7KRdJA7ipZYZevwsvtXSiqO.7pydLDOV4LsK6vSME13nwBrmvOK37BMh7DrKtZUS5n3U2kJ4beucJ64RDeB4vxj0RNeCpPDv6wLAcanNMYuAoZFFVLsQAh.qa5npVk59ZDw3Nkh53rBwlauUXNF1.LKYDL7sRnCP1F.DIalBKwI.AQWoZ.CvCrE_',};var a = document.createElement('script');a.src = '/cdn-cgi/challenge-platform/h/b/orchestrate/chl_page/v1?ray=a347c9762d494f8d';window._cf_chl_opt.cOgUHash = location.hash === '' && location.href.indexOf('#') !== -1 ? '#' : location.hash;window._cf_chl_opt.cOgUQuery = location.search === '' && location.href.slice(0, location.href.length - window._cf_chl_opt.cOgUHash.length).indexOf('?') !== -1 ? '?' : location.search;if (window.history && window.history.replaceState) {var ogU = location.pathname + window._cf_chl_opt.cOgUQuery + window._cf_chl_opt.cOgUHash;history.replaceState(null, null,"/en-GB/ShellCareers/job/Assen/Pipeline-Engineer_R205925-1?__cf_chl_rt_tk=1oIrpahASvpbXKvK5y.F.fv_iq6DjoVsQMahdUTCxX8-1788302534-1.0.1.1-Vfnhz8k00893bvb7Xswj6vcn1XANdv5pRp4q0sa.9Z4"+ window._cf_chl_opt.cOgUHash);a.onload = function() {history.replaceState(null, null, ogU);}}document.getElementsByTagName('head')[0].appendChild(a);}());
Support ID: a347c9762d494f8d Client IP: 159.195.17.177

Pipeline Engineer

Compensation

Not specified

City: Not specified

Country: Netherlands

Shell logo
Commodities

6 days ago

No clicks

at Shell

ExperiencedNo visa sponsorship

**Pipeline Engineer** Design, implement, and maintain data pipelines using Apache Airflow. Manage pipeline infrastructure, ensuring smooth data flow and optimal performance. Key responsibilities include developing data processing scripts, integrating with AWS services (Glue, S3, Redshift), and collaborating with DataOps teams. Minimum of 3 years of experience in a similar role, with expertise in Python, Airflow, AWS, and SQL. Familiarity with Agile methodologies and ETL processes a plus.

Full Job Description

Security Check

Verification successful. Waiting for shell.wd3.myworkdayjobs.com to respond
Enable JavaScript and cookies to continue
(function(){window._cf_chl_opt = {cFPWv: 'b',cH: 'KQwKZ6mokInVOwsNshaglj0VtkPzFRMvN.cp7S5Z6pA-1788302534-1.2.1.1-vnL2g1qBdtf4NrjKBQ0C3h_IUgGPKJCm6qBNzmwcVvP4AamNHK.bbv8vb_jZsRt6',cITimeS: '1788302534',cRay: 'a347c9762d494f8d',cTplB: '0',cTplC:1,cTplO:0,cTplV:5,cType: 'managed',cUPMDTk:"/en-GB/ShellCareers/job/Assen/Pipeline-Engineer_R205925-1?__cf_chl_tk=1oIrpahASvpbXKvK5y.F.fv_iq6DjoVsQMahdUTCxX8-1788302534-1.0.1.1-Vfnhz8k00893bvb7Xswj6vcn1XANdv5pRp4q0sa.9Z4",cvId: '3',cZone: 'shell.wd3.myworkdayjobs.com',fa:"/en-GB/ShellCareers/job/Assen/Pipeline-Engineer_R205925-1?__cf_chl_f_tk=1oIrpahASvpbXKvK5y.F.fv_iq6DjoVsQMahdUTCxX8-1788302534-1.0.1.1-Vfnhz8k00893bvb7Xswj6vcn1XANdv5pRp4q0sa.9Z4",md: 'n27_vJERKpF5clkyUixK0R7KbhPHpQQbK5ruq4d15sY-1788302534-1.2.1.1-j3d9nq9aotprnMpjSRVnF7dbSLF.xr66bo0UOd.LiZ8HWzLOD.5MhPr8izZ9EoiS9CVQyD7lVpXdcK.k3Pg_LM8xY47Hj5iBCd2JB8wSzOYVd5Lonno_n2KsV8DoCw5nIe1oNxCe8yRr_NJiBlt80POqIFTTd25rzZrnXePk5t1EQsoY_pGI460RYjcc6R3w7jo63NLawKlsuuv0LVXaPrndf5wiFC9L4fNl9LUpKbaqTOg8DNpr1vINnouJb7dHhbQd_HqEg32Qk.1ViR92Wb_oqnmLejaPnz6H9ZBNm9BlNLF9YqzzuvAmutuASiM8yQnnHqod7dHTKwoYqh33aCBYwPAyoxeoKey9vULL78WdB2LnaSyLDSIwsNNudjM0hTumBR.vFirNZ9F6hZ34P.sjh3cDWWTWO.jPMfPeblgf.Tea83BmM1D3kuLMmhU0TvDKBk5BBGf.uo.Ovt_JbiZ0D5JAVWTtQ7jiavxqY_IAeBS8OQ3auvzGC4JHyqAGHe_WPkzNgMggo8lVncXE3uKP_tp5ODJCZdjhIPUlWGKRekXybK15sZrsKvlcnlz7CJNbivH2MMbzPxlJIUEFk2muGEPmA5sB7wx7mXfBQd_phrSxbPpIJ_9dLHTX3fCgIzSe5VMrd4bHhcwGr1Z9FEzIsUD2vGwSMigfO61Q201j3wH4nzgnR.NmUoUl6KzXMRIZigmhr_qeGYIh0XnB1Pa18UgzR0NlYQYcsn2JxhJX1uaEnDg1WTXE9lkV3.84olC_Q8Cp4Gv.nCUNBxN9y09EBlu_pi5FPIDAmQUCzMGw97hKhLXougjtvAAlph6Lz07Hri9oR6iEt7YpbfTF45WEdTZTBsnLBSEqeDYZSh17_rvXRWBpEK_XH_roOhaXSZaKJuFrr3p8HC76S_Li.s0eBAIp3s78YCXf_nSUI3FGNSnPhQ0TBZAAq81vRxwOd4rqfI.5AWtKdVxtowh6uBAXcR_m65rpiCz.Yt.iQvgsG7lJwbz9kAMhGzHa288xlAjKoL3MGQ9XsPghO0Zj63S9.v2FHaA3xJunaz6caOtHjldOpXoLe4DHhDB0CZWrAS3ovKqAGfjJxTLY_OCBLS8sXrisW7thFtIDGZ6tum2UuAkpvFQQyPuifO5nyOtLx9ikhdknvtb1_RakS0cDQMZb1vUiozBWw82Yj1LdHpkjaPNRO_v1u8MN8vEmy13gNWBX6dpidVfHbn1s3GYKUf5YLkS1ioxbGWRnnYOz_1qYA0M6yKP_Xgce43kbM.Lx9KGAXVnJszchPl3khTE8lAkHeX52DxtFwNAU92H7Asc',mdrd: 'w31Yx50Bvf1gzxa9U2lL0QLJY922RD2GJ9ny0_s7YI0-1788302534-1.2.1.1-IW6NeH_WiszO8CvWO5QZFY7CkkPDjHkAiq0dXc6MgQMqncUaQGlJTtXW6T2DGUTgCoQmcoytxi9Bk7qGOUyZFq6Dfuilt.Cu_jrzUxr6BS5khAA2dLstlGks_fgRAIhXbCBPgVexlCBl0qAjPSpgG1lnocOuXQEERk7Qy7.yDDKxfX_xjRd9U4q_CHt.HgM4RZlLjjoXZLn3MBQbD_Ea3jYKnMJKo8zEz4fDmNRkWwr6ht5rkKBnvh_WQLu_nHmqi5s6uVi4BWpYzj_kkyJPYVL6YXfzy_WiF8gHOpToT5Dblj5XF6WcXy7h_jRx2X.4iNJWGGbZIfm_LAHLBfWmjhE2NpHNAemeheuBYXP7RkvzTONqRD4G6jbAmUXjMPN93i.HbB_x7KRdJA7ipZYZevwsvtXSiqO.7pydLDOV4LsK6vSME13nwBrmvOK37BMh7DrKtZUS5n3U2kJ4beucJ64RDeB4vxj0RNeCpPDv6wLAcanNMYuAoZFFVLsQAh.qa5npVk59ZDw3Nkh53rBwlauUXNF1.LKYDL7sRnCP1F.DIalBKwI.AQWoZ.CvCrE_',};var a = document.createElement('script');a.src = '/cdn-cgi/challenge-platform/h/b/orchestrate/chl_page/v1?ray=a347c9762d494f8d';window._cf_chl_opt.cOgUHash = location.hash === '' && location.href.indexOf('#') !== -1 ? '#' : location.hash;window._cf_chl_opt.cOgUQuery = location.search === '' && location.href.slice(0, location.href.length - window._cf_chl_opt.cOgUHash.length).indexOf('?') !== -1 ? '?' : location.search;if (window.history && window.history.replaceState) {var ogU = location.pathname + window._cf_chl_opt.cOgUQuery + window._cf_chl_opt.cOgUHash;history.replaceState(null, null,"/en-GB/ShellCareers/job/Assen/Pipeline-Engineer_R205925-1?__cf_chl_rt_tk=1oIrpahASvpbXKvK5y.F.fv_iq6DjoVsQMahdUTCxX8-1788302534-1.0.1.1-Vfnhz8k00893bvb7Xswj6vcn1XANdv5pRp4q0sa.9Z4"+ window._cf_chl_opt.cOgUHash);a.onload = function() {history.replaceState(null, null, ogU);}}document.getElementsByTagName('head')[0].appendChild(a);}());
Support ID: a347c9762d494f8d Client IP: 159.195.17.177