课程解决什么问题

这门课程聚焦于大数据环境下的用户画像构建，主要用于解决企业如何通过海量用户数据进行精准分析，从而优化产品策略、提升营销效率等实际问题。课程围绕用户数据的收集、清洗、处理、建模和可视化全流程展开，特别强调处理高维数据时的性能优化和算法选择，适合希望将数据能力转化为业务价值的业务分析师、数据分析师或初级数据科学家。

适合什么基础及如何使用资料

学习这门课需要具备Python基础，熟悉SQL查询，了解Hadoop生态（HDFS、MapReduce）和Spark的基本原理。资料包按天划分，包含理论讲解、代码示例和项目实战。建议先通过前三天内容掌握数据预处理和特征工程的核心方法，结合《day01_20200925》至《day03_20200929》的练习题巩固 Pandas 和 NumPy 操作。项目实战阶段重点参考《day06_20201009》的用户聚类案例，这段内容直接关联课程目标，可独立完成从数据接入到模型评估的全链路操作。资料中的Notebook需配合线上平台（如云服务器）同步运行，确保代码环境的兼容性。

学完能独立做什么及资料配合练习

学完后，可以独立完成电商或社交领域的用户画像项目，包括：搭建数据管道、处理缺失值和异常值、设计用户标签体系、应用聚类算法（如K-Means）或关联规则挖掘。例如，利用《day08_20201012》的代码模板，结合实际业务数据构建用户分群模型，并通过《day09_20201014》的指标体系进行效果评估。资料中的分步代码需与项目文档结合使用，建议每完成一个模块（如数据清洗）后，直接应用《day05_20201007》的测试数据集验证结果，逐步将模块整合为完整流程。注意实践时需调整参数（如聚类K值），以匹配特定业务场景的标签粒度要求。

课程目录

课程目录23 集
  • 【黑马程序员】大数据项目用户画像实战 ????????????????????? ?????? ????????????????????????????????????????????????????AI????????? ? ????? ???��????????????????????????????????????????????????????????????????????????????????? ?��????? ? ???????? ? ???????? ? ???????????? �γ�Ŀ¼ ? day01_20200925 19_??????????????????????.wmv [14.7 MB] 10_?????360?????????????????????????????.wmv [71.9 MB] 14_?????360??????????????????????????.wmv [41.8 MB] 07_?????360?????????????????????????????.wmv [51.3 MB] 05_?????360????????????????????????????.mp4
  • [112.2 MB] 26_????????????????????????Hive??.mp4
  • [19.5 MB] 11_?????360????????????????????.wmv [24.6 MB] 09_?????360??????????????????????.wmv [49.0 MB] 16_?????WEB ?????????(4???????.wmv [51.8 MB] 12_?????360???????????????????????????.wmv [37.8 MB] 21_?????????????????????.wmv [119.0 MB] 02_?????360????????????????????????.wmv [46.3 MB] 22_??????????????Project??Module.wmv [60.4 MB] 01_?????Spark ???????????.mp4
  • [17.5 MB] 08_?????360????????????????????????.wmv [16.6 MB] 03_?????360??????????????????????????.wmv [18.6 MB] 06_?????360?????????????????????HBase??ES??.mp4
  • [174.4 MB] 24_???????????????????????????????????.wmv [45.5 MB] 25_?????????????????Hive????????.wmv [43.1 MB] 20_????????????????????.wmv [32.6 MB] 13_?????360???????????????????????.wmv [35.1 MB] 18_?????WEB ???????????????.wmv [20.8 MB] 17_?????WEB ?????????????.wmv [23.1 MB] 15_?????WEB ??????????????123???????.wmv [37.8 MB] 04_?????360???????????????????????????????????.wmv [86.8 MB] 23_?????????????????ETL????.wmv [24.6 MB] ? day09_20201014 09_?????????????USG??????????????ID3??C4.5??CART??.wmv [88.1 MB] 01_?????????????????????.mp4
  • [31.0 MB] 05_?????????????USG??USG??????????????.wmv [39.7 MB] 12_?????????????USG????????.wmv [41.7 MB] 07_?????????????USG????????????.wmv [27.0 MB] 20_?????????????USG??Pipeline ???????.wmv [43.1 MB] 21_?????????????USG?????Pipeline???.wmv [71.3 MB] 08_?????????????USG?????????????????.wmv [51.9 MB] 19_?????????????USG??Pipeline??????.wmv [40.1 MB] 23_?????????????USG??????????????ParamGrid.wmv [11.7 MB] 13_?????????????USG????p????????????????.wmv [33.9 MB] 24_?????????????USG??TrainValidationSplit??????.wmv [40.9 MB] 14_?????????????USG?????????????????????.wmv [21.6 MB] 22_?????????????USG??????????????????????.wmv [34.3 MB] 04_?????????????USG??USG??????????.wmv [27.6 MB] 10_?????????????USG???????????????????????.wmv [45.5 MB] 03_??????????????.wmv [61.0 MB] 18_?????????????USG??????????????????.wmv [42.0 MB] 02_?????????????RFE??PSM???.wmv [36.0 MB] 06_?????????????USG??USG???????????????.wmv [57.3 MB] 11_?????????????USG????????????????????????.wmv [64.9 MB] 25_?????????????USG??CrossValidator??????.mp4
  • [51.3 MB] 17_?????????????USG?????????????????.wmv [75.7 MB] 16_?????????????USG?????????????.wmv [93.5 MB] 15_?????????????USG???????????????WHEN???????.wmv [55.4 MB] ? day10_20201015 02_????????????????Pipeline????????.wmv [59.7 MB] 01_?????????????USG???????????.mp4
  • [50.9 MB] 16_????DataFrame API???????????????????????????????????.wmv [85.4 MB] 06_??????????Boosting ?????????????GBT.wmv [27.3 MB] 21_?????????????BP??????????????????????????????.wmv [44.9 MB] 14_?????????????BP???????????.wmv [59.9 MB] 17_????DataFrame API???????????????????????????????.wmv [52.3 MB] 11_?????????????????????Hive????HiveMeta??.wmv [40.3 MB] 19_?????????????BP?????????????????????.wmv [28.6 MB] 18_?????????????BP??????????????????????????????.wmv [47.6 MB] 12_?????????????????????HDFS?????HDFSMeta??.wmv [40.9 MB] 23_?????????????BP??????????????HBase??.wmv [65.9 MB] 20_?????????????BP??????????????????.wmv [31.6 MB] 09_??????????????????????????????????.wmv [52.4 MB] 15_?????????????BP???????ALS.wmv [31.1 MB] 05_??????????Bagging??????????RF.wmv [64.6 MB] 10_?????????????????????MySQL????MySQLMeta??.wmv [103.0 MB] 13_?????????????BP??Bp??????.wmv [9.9 MB] 22_?????????????BP??????ALS???????????????.wmv [118.3 MB] 07_??????????????.wmv [40.0 MB] 08_????????????????????????????.wmv [24.5 MB] 25_???????????????????.mp4
  • [48.9 MB] 03_??????????Ensemble Algorithm????.wmv [37.7 MB] 24_???????????????????.wmv [61.5 MB] 04_??????????Bagging????Boosting??.wmv [18.2 MB] ? day02_20200927 28_????????????????????4????h.wmv [14.5 MB] 22_??????????????????????????Install??.wmv [55.3 MB] 23_??????????????????????????????.wmv [38.1 MB] 16_Oozie Java Client API????Coordinator.wmv [57.3 MB] 10_?????????????????BulkLoad?????????????Spark??.wmv [79.7 MB] 05_?????????????????HBase ImportTvs????logs????.wmv [52.6 MB] 01_????????????.mp4
  • [59.5 MB] 11_???????????????.wmv [28.2 MB] 03_??????????????????????????.wmv [26.7 MB] 24_?????????????????????????????????????.wmv [39.0 MB] 14_Oozie Java Client API??????.wmv [58.6 MB] 04_?????????????????SQOOP????HBase??.wmv [22.1 MB] 27_??????????????????????????.wmv [14.8 MB] 15_Oozie Java Client API????Workflow.wmv [56.8 MB] 17_??????????????????.wmv [15.7 MB] 25_?????????????????????????????.wmv [28.2 MB] 13_Oozie????Spark2?????Hue?????????????????????Spark2.wmv [50.2 MB] 21_??????????????????????.wmv [33.4 MB] 20_?????????????l???????.wmv [33.4 MB] 18_????????????????????.wmv [21.2 MB] 06_?????????????????????????Put??BulkLoad.wmv [15.5 MB] 08_?????????????????BulkLoad??????????????????.wmv [44.7 MB] 26_???????????????????Module???????????.wmv [30.8 MB] 09_?????????????????BulkLoad?????????????MR??.wmv [85.2 MB] 02_??????????????.wmv [21.0 MB] 19_??????????????????????.wmv [7.9 MB] 07_?????????????????HBase ImportTvs??BulkLoad.wmv [53.1 MB] 29_Spark ????HBase????????????.mp4
  • [56.6 MB] 12_Oozie????Spark2?????Oozie???????????.wmv [38.5 MB] ? day06_20201009 14_????????????????????????????????.wmv [39.5 MB] 17_??????????????????????????????.wmv [67.2 MB] 06_???????????ML??????.wmv [66.1 MB] 01_?????????????????????????HBase????????.mp4
  • [51.3 MB] 07_?????????????????????SK-Learn??SparkMLlib.wmv [45.8 MB] 16_?????????????????????????????.wmv [95.5 MB] 12_???????????????????????????????????.wmv [88.7 MB] 13_???????????????????????.wmv [44.6 MB] 03_??????????????.wmv [16.2 MB] 10_??????????????????????????label????????.wmv [53.8 MB] 02_??????????????????ALS.wmv [90.2 MB] 18_????????????????????????????Sigmoid??????.mp4
  • [35.2 MB] 15_???????????????????????????????.wmv [27.7 MB] 04_???????????AI??????????????????????.wmv [74.2 MB] 05_???????????ML?????????????features.wmv [73.2 MB] 11_?????????????????????????features???????.wmv [38.4 MB] 08_?????????????????????.wmv [32.5 MB] 09_??????????????????????????????.wmv [78.6 MB] ? day07_20201011 02_??????????????????????????.wmv [59.5 MB] 04_?????????????????????????????????CSV?????.wmv [17.3 MB] 16_?????????RFM??KMeans?????????????.wmv [92.9 MB] 13_?????????RFM????????????RFM Score.wmv [34.2 MB] 23_?????????RFM????????????????????.wmv [41.1 MB] 17_?????????RFM?????????????SSE.wmv [13.2 MB] 22_?????????RFM??????????????.wmv [101.1 MB] 10_?????????RFM?????????????????.wmv [32.4 MB] 11_?????????RFM??????????????????.wmv [16.6 MB] 05_????????????????????????????????.wmv [32.2 MB] 15_?????????RFM??KMeans?????????.wmv [54.4 MB] 19_?????????RFM??KMeansII??.wmv [21.5 MB] 09__?????????RFM??RFM??????.wmv [31.0 MB] 24_?????????RFM??KMeans??2??????.wmv [62.3 MB] 27_?????????RFM??????????????????????K.mp4
  • [71.2 MB] 12_?????????RFM????????????????RFM.wmv [72.7 MB] 08_?????????RFM??RFM????..wmv [30.7 MB] 25_?????????RFM??KMeans????????.wmv [15.3 MB] 18_?????????RFM??KMeans++??.wmv [19.5 MB] 01_?????????????????????????????.mp4
  • [44.9 MB] 06_????????????????????????LR???????????????.wmv [36.0 MB] 20_?????????RFM??KMeans??????.wmv [64.2 MB] 21_?????????RFM?????????????.wmv [58.3 MB] 07_??????????????.wmv [17.0 MB] 03_?????????????????????????????????????????.wmv [69.0 MB] 14_?????????RFM?????????????.wmv [41.6 MB] 26_?????????RFM??KMeans?????????.wmv [37.1 MB] ? day05_20201007 12_????????????HBase???????????Condition??????.wmv [56.3 MB] 26_??????????????RDD ??API????.wmv [39.1 MB] 09_????????????HBase??????????????????.wmv [20.7 MB] 28_????????????????????????????.mp4
  • [34.4 MB] 11_????????????HBase??????????????????????????????.wmv [48.5 MB] 02_??????????????????????????.wmv [32.3 MB] 10_????????????HBase??HBase Filter???.wmv [39.8 MB] 19_????????????HBase??????????????.wmv [52.0 MB] 22_???????????????????????.wmv [29.3 MB] 08_??????????????.wmv [56.6 MB] 16_????????????HBase??????WhereCondition??????????????.wmv [32.1 MB] 01_?????????????????????????HBase.mp4
  • [65.0 MB] 13_????????????HBase???????????????????.wmv [73.9 MB] 23_??????????ALS?????.wmv [43.6 MB] 15_????????????HBase?????????a????DateUtils.wmv [43.1 MB] 17_????????????HBase??????WhereCondition???????????.wmv [38.5 MB] 07_??????????????????????????????????????????.wmv [9.0 MB] 05_????????????????????????.wmv [56.9 MB] 27_???????????????????????????.wmv [66.3 MB] 21_???????????????????.wmv [91.6 MB] 20_??????????????????????????????.wmv [97.4 MB] 25_??????????????Maven Module.wmv [43.4 MB] 04_????????????????????????????????????????.wmv [48.5 MB] 14_????????????HBase???????????rule????WhereCondition???.wmv [27.1 MB] 18_????????????HBase??????WhereCondition????????????.wmv [52.9 MB] 24_????????????????????????????.wmv [25.5 MB] 06_?????????????????????????????????????????.wmv [22.5 MB] 03_????????????????????????????.wmv [32.3 MB] ? day08_20201012 26_????????????PSM?????KMeans???????????.wmv [60.2 MB] 23_????????????PSM??????PSM???????.wmv [26.4 MB] 22_????????????PSM?????KMeans????????????.wmv [39.2 MB] 21_????????????PSM??PSM?????.wmv [36.4 MB] 08_?????????RFM????????????????.wmv [49.2 MB] 17_???????????RFE??KMeans???????????.wmv [43.8 MB] 15_???????????RFE?????????????????.wmv [71.3 MB] 18_ID-Mapping???????????????????.wmv [40.7 MB] 20_????????????PSM??PSM????????.wmv [28.5 MB] 05_?????????RFM???????????.wmv [33.4 MB] 16_???????????RFE?????????.wmv [38.3 MB] 10_?????????RFM???????????????????.wmv [21.2 MB] 12_???????????RFE??RFE??????????????.wmv [21.1 MB] 07_?????????RFM?????????????????????.wmv [64.0 MB] 27_????????????PSM?????????????????.mp4
  • [19.7 MB] 13_???????????RFE??????????????????.wmv [30.2 MB] 25_????????????PSM??????PSM????????.wmv [74.3 MB] 09_?????????RFM?????????????????.wmv [121.6 MB] 19_ID-Mapping???????????????????.wmv [47.5 MB] 14_???????????RFE???????????????????RFE????.wmv [39.5 MB] 01_?????????????????KMeans??.mp4
  • [43.2 MB] 24_????????????PSM??????PSM???????.wmv [25.9 MB] 03_??????????????.wmv [18.8 MB] 02_??????????????????????RFM.wmv [55.8 MB] 11_???????????RFE??????????????????????.wmv [35.2 MB] 06_?????????RFM????????????????????.wmv [98.8 MB] 04_?????????RFM?????????????????.wmv [45.3 MB] ? day03_20200928 37_?????????????????v????????SparkUitls.wmv [57.2 MB] 20_??????????????????????????????????????.wmv [30.2 MB] 27_??????????????????????????????????????????.wmv [22.0 MB] 35_?????????????????v??????SparkSession??????.wmv [40.4 MB] 36_?????????????????v??Typesafe????????????.wmv [24.1 MB] 26_????????????????????????????????.wmv [22.2 MB] 14_??????HBaseTools??write?????????????.wmv [19.7 MB] 16_????????????????????????????????.wmv [29.8 MB] 29_?????????????????v????????????Template??.wmv [8.4 MB] 07_???????????????????????????????4????5????.wmv [47.9 MB] 34_?????????????????v???????????????????.wmv [52.4 MB] 32_?????????????????????????????????????????.wmv [23.4 MB] 30_?????????????????v?????????BasicModel??.wmv [18.9 MB] 25_???????????????????????????UDF????????.wmv [77.8 MB] 08_??????????????????????????????????SparkSession??????.wmv [12.7 MB] 11_??????HBaseTools??read????????(????.wmv [25.4 MB] 04_??????????????????????????????.wmv [38.5 MB] 21_??????????????????????????????????.wmv [18.1 MB] 09_??????HBaseTools??????????????.wmv [27.9 MB] 05_??????????????.wmv [33.4 MB] 22_?????????????????????????????.wmv [14.7 MB] 28_?????????????????v??????????????????.wmv [34.2 MB] 01_?????????????.mp4
  • [18.8 MB] 39_?????????????????v???????????????.mp4
  • [41.9 MB] 19_????????????????????????????????????.wmv [17.8 MB] 18_??????????????????????????????.wmv [42.0 MB] 10_??????HBaseTools??read????????(???.wmv [53.0 MB] 38_?????????????????v????????????AbstractModel.wmv [24.1 MB] 12_??????HBaseTools??read????????(????.wmv [37.7 MB] 02_???????????????????????ETL.wmv [31.7 MB] 13_??????HBaseTools??write????????????.wmv [32.4 MB] 31_?????????????????v?????????BasicModel???????.wmv [31.4 MB] 15_????????????????????????????????.wmv [40.5 MB] 33_?????????????????????????????????????.wmv [64.3 MB] 17_???????????????????????HBase?????Meta???????????.wmv [36.7 MB] 23_?????????????????????????????.wmv [20.0 MB] 03_?????????????????????????.wmv [29.5 MB] 24_???????????????????????????SparkSession??????Hive??.wmv [21.3 MB] 06_?????????????????????????????????.wmv [10.6 MB] ? day04_20200929 22_???????????????????????????????????????.wmv [49.0 MB] 25_????????????????????????????????.wmv [22.3 MB] 06_???????????????????????????????????.wmv [32.8 MB] 15_????????????HBase????????load?????????.wmv [50.4 MB] 14_????????????HBase????????load????????.wmv [36.7 MB] 03_???????????????????????????????.wmv [26.6 MB] 07_?????????????????????????????????.wmv [13.8 MB] 11_????????????HBase??BaseRelation???.wmv [24.6 MB] 20_????????????????????.wmv [42.5 MB] 09_????????????HBase??????ExternalDataSource.wmv [44.2 MB] 28_??????????????????????????????????????.wmv [17.5 MB] 33_????????????????????????????????????SQL??DSL??.wmv [57.6 MB] 30_???????????????????????????????.wmv [80.6 MB] 08_??????????????.wmv [23.9 MB] 02?????????????HBaseTools??????.wmv [34.9 MB] 05_???????????????????????????????.wmv [39.0 MB] 24_??????????????????????????????????????.wmv [57.7 MB] 16_????????????HBase????????save????.wmv [37.4 MB] 19_????????????HBase??Spark??HBase?????????????.wmv [28.1 MB] 12_????????????HBase??RelationProvider???.wmv [19.7 MB] 17_????????????HBase??????????.wmv [39.3 MB] 18_????????????HBase???????????AbstractModel.wmv [38.5 MB] 29_??????????????????????????????????????????????????.wmv [49.2 MB] 31_??????????????????????????????????.wmv [29.6 MB] 13_????????????HBase????????HBaseRelation??DefaultSource.wmv [32.3 MB] 26_???????????????????????????????.wmv [45.0 MB] 34_????????????????????????????????????.mp4
  • [38.1 MB] 23_?????????????????????????????????????.wmv [26.4 MB] 04_??????????????????????.wmv [40.3 MB] 21_?????????????????????????????????????????.wmv [47.2 MB] 27_???????????????????????.wmv [54.7 MB] 32_??????????????????????????????.wmv [41.8 MB] 10_????????????HBase??External DataSource????.wmv [18.8 MB] 01_???????????????????????????.mp4
  • [28.4 MB] ?????? ?????????? ???????? AI???????? ѧϰ�ջ� ???????????????? ?????????????????? ??????????????????? ???????? ????????????????