0
点赞
收藏
分享

微信扫一扫

Mac Apache-spark 单机安装


Java

下载安装Mac对应版本的​​JDK​​。

Apache-spark

$ brew update
$ brew info apache-spark
$ brew install apache-spark

安装scala

$ brew install scala
$ brew install sbt

其他包

$ pip install sklearn
$ pip install mllib
$ pip install networkx
$ pip install igraph
$ pip install findspark

验证

Mac Apache-spark 单机安装_scala

其他资料

  • K-Means++资料:
    ​​​https://github.com/endymecy/spark-ml-source-analysis/blob/master/%E8%81%9A%E7%B1%BB/k-means/k-means.md​​​
    ​​​http://coolshell.cn/articles/7779.html​​​
    ​​​https://github.com/sumnous/MLlearn/blob/master/kmeans%2B%2B.py​​
  • 聚类系列文章:
    ​​http://blog.pluskid.org/?tag=clustering​​
  • Spark GraphX:
    ​​https://spark.apache.org/docs/1.2.0/api/java/org/apache/spark/graphx/​​
    ​​https://amplab.cs.berkeley.edu/wp-content/uploads/2014/02/graphx@strata2014_final.pdf​​
    ​​https://databricks-training.s3.amazonaws.com/slides/graphx@sparksummit_2014-07.pdf​​
  • Python版GraphX代替-GraphFrames:
    ​​https://databricks.com/blog/2016/03/03/introducing-graphframes.html​​
    ​​http://graphframes.github.io/user-guide.html​​
  • LPA算法介绍文章:
    ​​​https://greatpowerlaw.wordpress.com/2013/02/08/community-detection-lpa/​​​
    GraphX实现LPA介绍文章:

    ​​​http://graphframes.github.io/user-guide.html#label-propagation-algorithm-lpa​​
  • Anti-spam这块没有很多公开资料,知乎有两个回答还不错:
    ​​https://www.zhihu.com/question/20103086​​
    ​​http://www.zhihujingxuan.com/26818.html​​
  • 金融反欺诈:

    ​​​http://www.argyledata.com/files/FightingFutureFraud-eBook.pdf​​​
    ​​​http://chuansong.me/n/1092747​​
  • ​​Spark 运维实战​​
  • ​​Spark开发指南​​


举报

相关推荐

0 条评论