● Responsible for the whole project, which does help the chinese sellers on Amazon platform in making decisions of what commodities to sell. includes spider, which does crawl the whole Amazon US site data , big data batch process, backend, and front end subsystems.
● Lead the 30-person team, design the system architecture, manage the whole project development progress and deliver the project on time.
● Build the spider cluster with 40 servers, elasticsearch cluster with 45 servers, and do performance tuning.
Published:December 17, 2022