What's your role? As a Data Engineer, you will help design, improve and maintain our ETL processes. Without which we could not perform our investigations. You'll help find reliable and efficient ways to extract data on what companies are investing in from both public and private sources. More specifically, you'll help us solve these problems:
- How can we reliably and efficiently scrape and pull data from hundreds of websites and APIs?
- Are there better datasets available to assess what a company's investing in?
- How can we improve data features used by our machine learning algorithm?
- What structure and format should we load the data for analysis?
- What reports and visual best communicate the insight?
- Is our data accurate and timely?
Toolkit? We don't believe in hiring based on tools you have experienced with. We're much more interested in people who can find the root cause of a problem, and research/learn the best tool to help solve that problem. Does that sound like you? Tools we currently use include Python/NLTK, SQL, Tableau, but we are more than willing to drop them if you identify more effective toolkits.
What should you expect? This job is NOT for those who struggle with ambiguity, need constant guidance, and say yes without asking why. We seek a leader, not a follower. Someone not afraid to speak up and stand up for the right ideas. That's because you will work directly with the leadership team and help shape the long-term outlook for The Battle of Giants. Do you enjoy getting outside your comfort zone? Do you naturally question assumptions, investigate root cause of problems, and think outside the box?
What benefits are offered? We strongly believe in smelling the roses along the journey. It's going to be a long and challenging journey. We thus offer supplemental health coverage, 4 weeks paid time off, unlimited sick days, and the opportunity to design your own workstation/computer setup. We also encourage you to take Friday to work on something different and think outside the box: Volunteer, create art, build something useful for the community. Just don't do what you do Monday to Thursday.
What happens after you apply? We will shortlist candidates we believe will be most successful in this role, and send along a quick exercise as the next step. This helps you get a sense of the day to day work. And it also helps us understand how you think. There will be multiple ways to complete the exercise, so don't worry about finding an ideal solution. Do what you would normally do, using the tools you're familiar with. We just want to learn about you!
