Hadoop Jobs

Job Title: Build Bond Price Research System Using BigQuery and Machine Learning Job Description: We are seeking an experienced freelancer to develop a Bond Price Research System based on client requirements. Commbined with Machine Learning to enable powerful search, analysis, and insights into bond prices. Project Scope: - Design and build a scalable research platform for searching and analyzing bond price data (government bonds, corporate bonds, etc.). - Store and query large volumes of historical and current bond data in BigQuery. - Integrate Machine Learning models to support price analysis, trend detection, forecasting, and other research features. - Customize the solution according to the client’s specific needs. Key Requirements: 1. Technical Skills (Required): - Strong...

I need an experienced Natural Language Processing specialist to build a predictive model that learns from text data and produces accurate, repeatable forecasts. The project centers on end-to-end model creation: cleaning and preprocessing raw text, selecting the right architecture, training, and evaluating performance against clearly defined metrics. I will supply the text dataset along with the target variable I want predicted. You will decide on the most suitable NLP approach—whether that’s classical techniques with scikit-learn or a deep-learning stack such as TensorFlow or PyTorch—document your reasoning, and implement the solution in clean, well-commented Python. Deliverables: • Reproducible code (Jupyter notebook or .py files) with setup instructions • ...

Responsible for designing and implementing large-scale data migration and ingestion pipelines to move high-volume data from diverse sources into cloud platforms. Sources include HDFS, relational databases such as MySQL and PostgreSQL, and real-time streaming systems like Kafka. Develop and maintain robust data pipelines using PySpark, ensuring efficient processing of batch and streaming data. Implement automated scheduling mechanisms to orchestrate data workflows on daily and monthly intervals, ensuring reliability and timely data availability. Optimize data ingestion and storage through advanced performance tuning, partitioning, and compaction strategies to handle large-scale datasets efficiently. Ensure data quality, consistency, and fault tolerance across all pipelines. Deploy and ma...

Description I am building a research-driven job market analytics system (US market). This is not just a development project — it requires designing, executing, and evaluating data science experiments. The goal is to analyze job data and produce validated insights, not just build a working pipeline. Scope of Work The project includes: • Data processing of large job datasets (10k–50k+ rows) • Extracting technical skills (Python, SQL, AWS, etc.) from job descriptions • Salary analysis and estimation (validated using official BLS data) • Job demand trend analysis and forecasting • Building an interactive dashboard (Streamlit preferred) • Designing and executing research experiments with clear evaluation metrics Research Requirements (Core o...

? HAGO Contest #2 – April ? For data scientists and analytics enthusiasts, we present a new challenge with Amazon sales dataset. ? Tasks: Explore the dataset in depth Analyze patterns and trends Build a predictive model using Python Submit results in a PDF file within our private community ? Prize: The winner receives $15 USD for the best analysis and prediction ? Don’t forget to join the IFAI Contest for future forecasting, where the winner earns $10 USD. ✨ Tips to increase your chances of winning: Make your analysis comprehensive yet easy to understand Add clear and insightful visualizations Focus on prediction accuracy and creative ideas