Location Detector
An application that detects the visitor's location based on the IP address.
This Node.js application is designed to read streaming data from various data sources in the form of IP numbers. It leverages the power of Node.js streams to efficiently process and transform the data. The application then interacts with an external API to perform specific operations with the IP numbers. Finally, the processed data is persisted for further analysis or usage.
- Utilizes Node.js streams for efficient and scalable data processing.
- Reads streaming data from diverse sources in IP number format.
- Interacts with an external API to perform operations on the IP numbers.
- Implements data persistence to store the processed information.
- This application provides a streamlined and flexible solution for handling streaming IP data, making it easier to process, interact with an external API, and persist the results for further utilization.
- CSV Reader
- JSONL Reader
- CSV Translator
- SQLite Translator
- External API Translator
- JSONL Writer
- Kafka Topic Writer
- axios
- colors
- csv-parse
- dotenv
- env-var
- kafkajs
- redis
- reflect-metadata
- sqlite3
- tsyringe
- jest
- typescript
If you don't have kafa and redis you can download with next script
sh scripts/download.sh
Start zookeeper
sh scripts/start-zookeeper.sh
Start kafka server
sh scripts/start-kafka.sh
Install redis server
cd ./apps/redis-7.0.11/ sudo make install cd utils sudo ./install_server.sh
Copy .env file
cp .env.dev .env
Install node using nvm
nvm install
Install node project dependencies
npm install
Start CLI application (Dev mode)
npm run cli:dev
Start CLI application (Production mode)
npm run build && npm run cli:prod
You can use helper to consume messages from location-output topic
npm run helper:location-output
You can see coverage test project with next script
npm run test
To get in touch, send an email to [email protected] or visit my website https://leandrodbdias.dev