Full stack python developer/engineer
We are looking for a multi-skilled and adaptable python developer experienced with mining data from varied sources, ETL, data processing, and SDK development.
The developer will work closely with the data science team to help enable and support their work and research. This will involve developing and taking ownership of python SDK’s and messaging systems to streamline the query of elasticsearch and MS SQL data stores and storage of new data sets. The developer will also be responsible for creating automated processes for mining data from our internal data stores or web sources on request.
Develop and maintain robust and flexible scraping of current data from select web sources & engineer upload of data to mongodb or other data storage. This process should be able to cope with minor table structure changes.
Historical scraping of data from select web sources, using wayback & engineer upload of data to mongodb or other data storage. This will need to handle historical changes to the structure of the data tables.
Create rabbit (or other messaging system) template script that will permit the data science team to upload new data sets.
Develop python SDKs providing intuitive access to company restful API’s and/or elasticsearch and MS SQL data storage to streamline data team workflow. API’s purpose and requirements will be outlined as needed
Messaging systems, such as Rabbit
32 freelancers are bidding on average $35/hour for this job
Hi, there. I have read your description carefully, so I can understand your requirement. I have high Python skill, and also data mining is my favorite subject. Looking forward to hearing from you. Best regards.