JOB DESCRIPTION

Big Data Engineer

Data Engineer/Data Scientist

About
About the company
A Japanese subsidiary of a US-based IT company.
With the aim of becoming a "problem-solving engine," it launched a search site and has been a leader in IT technology in Japan.
It has been a leader in IT technology in Japan.
With the largest share of the search engine market (used by about half of all Internet users), the site has generated a huge number of hits and a steady stream of advertising revenue.

Media, commerce, entertainment, finance, etc.
media, commerce, entertainment, finance, and many other fields.
It is one of the largest Internet services in Japan, with about 50 million monthly users.
It has become one of the largest Internet services in Japan, with about 50 million monthly users.

In order to achieve further growth, we will not only accumulate but also utilize the multi-big data generated from various services.
In order to achieve further growth, we are working on innovation to become a "multi-big data driven" company that not only accumulates but also utilizes multi-big data generated from various services.
We are working on innovation to become a "multi-big data driven" company that not only stores but also utilizes multi-big data generated from various services.
Global Aspects
  • Already foreign employee(s) working
JobDescription
This company will take on the challenge of making its data infrastructure a more robust and flexible next-generation platform, aiming to provide the best user experience and further business growth by leveraging the world's leading multi-big data.
Through the use of data, you will be able to contribute to our company's vision of "the world's most convenient country. You will be able to contribute to our vision of "the world's most convenient country" through the utilization of data.

The business domain you will be in charge of *The domain you will be in charge of and the nature of your work will be determined during the selection process.




 ・Development and operation of data platform to utilize shopping data
・Development and operation of shopping data platform
・BI report development
・Data utilization systems such as CRM and personalization
・Modeling using machine learning
- [DB] MySQL, Cassandra, Oracle, PostgreSQL, HBase DB construction, operation, performance optimization, development of operation automation tools such as database backup and restore
・ Data design and ETL data development and operation to make data generated by various services (PV, search logs, payment data, etc.) usable within the company
・Development of access analysis tools to analyze application access status and user behavior to help grow services
・ Development of functions for common recommendation platforms used in many services, and development of machine learning platforms that can utilize large-scale data


The working environment for engineers
* They have an extensive support system for improving engineering skills.
* Windows/Mac is selectable for PC.
* The development style varies depending on the service, but agile development is the main method, and many teams use Scrum as a method.
* Source code is shared on GitHub Enterprise. Chat communication tools are widespread, and the environment allows for easy online information exchange with engineers from other organizations.
* Paperwork and other tasks that should be omitted are minimized so that engineers can spend more time on development work itself.
* The office is a free-address space. The desks are deliberately arranged in a zigzag pattern to facilitate face-to-face communication in a well-designed office. There are also chairs that are surrounded to help you concentrate on your work.
* Remote work at home, etc. is possible using the Anywhere Office System.
* We have a flextime system with no core time, so you can leave the office early and participate in study sessions and events outside the office.
* The company believes CI/CD as a means to increase development efficiency in order to deliver more products that have value to users. For example, you can set up a server with a single click on the internal system.
* For example, we can set up a server with one click on our internal system. User feedback is picked up on a regular basis and utilized in service development.





※Please note that the position is only for those who are currently residing in Japan only
Requirements
Must
* Experience in development using DWH and Hadoop
* Experience in development using Big Data
* Experience developing on Linux
Experience with any of the following
* Experience in development using Java, Python, or Go
* Experience with database operations and optimal performance tuning
* Knowledge of SQL, table design, data maintenance and operations experience
* Experience using SQL (HiveQL)
* Basic knowledge of machine learning, experience developing and operating a large-scale machine learning infrastructure
Japanese Level
  • Advanced
Type of people (Personality)
-
Conditions
Annual Expected salary (Minimum)
4000000
Annual Expected salary (Maximum)
8000000
Salary promotion
Twice a year
Transporation cost coverage
  • Covered based on Company's set policy
Flextime
  • Yes
Holidays
  • End of Year and New Year Holiday
  • Golden Week
  • Saturday
  • National Holiday
  • Sunday
Insurances
  • Worker’s Accident Compensation Insurance (労災保険)
  • Health Insurance (健康保険)
  • Unemployment Insurance (雇用保険)
  • Welfare Pension Insurance (厚生年金保険)

Career opportunities for engineers
* They provide an environment where you can shape your career according to your own preferences and the skills and experience you want to acquire, such as reassignment to a different service or change of job type, through our transfer request system and weekly "1-on-1 meetings" with your superiors.
* In addition to a career in management, there is also a path to becoming a technical specialist through the "Black Belt System," which is given to outstanding expert human resources.