REPOSITORY OVERVIEWLive repository statistics
★ 0Stars
⑂ 0Forks
◯ 0Open issues
◉ 0Watchers
31/100
OPENREPOHUB HEALTH SIGNALLimited signals
A transparent discovery signal based on current public GitHub metadata.
Recent activity35% weight
10 Community adoption25% weight
0 Maintenance state20% weight
100 License clarity10% weight
0 Project information10% weight
75 This score does not audit code, security, maintainers, documentation quality, or suitability. Verify the repository and its current documentation before adoption.
README preview
mlSpark
Apache Spark application as end to end use case from data acquisition, transformation, model training and deployment.
Procedure
- setting.sh: Pull a Dataset of Accelerometer data from here.
- input.py: Load dataset and store it as a dataframe.
- transfrom.py: Transform the data into parquet files.
- train.py: Train and get the model file using pyspark ml.
- deploy.py: Deploy model into watson IBM Cloud.
Errors
Exception: Java gateway process exited before sending its port number
- Make sure you have JAVA8 (macOS)
brew tap adoptopenjdk/openjdk
brew install --cask adoptopenjdk8
- Find your JAVA8's home directory then add those two lines.
import os
os.environ['JAVA_HOME'] = "/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home"
ALGORITHMICALLY RELATEDSimilar Open-Source Projects
Selected from shared topics, language and repository description—not editorial ratings.
This data pipeline project focuses on ingesting and processing raw stock market data, performing feature engineering on top of the processed data, training a predictive model, and building an API service to serve the trained model.
34/100 healthActive repositoryHas homepage
PythonNo license#airflow#dag#data-engineering#data-science
⑂ 0 forks◯ 0 issuesUpdated May 5, 2023
Project homepage ↗