人工精选【编程】大数据实战:黑马程序员带你打造用户画像
如果你在数据岗位或准备转行做数据开发,用户画像这个词大概率绕不开。它听起来像产品经理的活儿,实际落地时却是实打实的工程问题:埋点日志怎么收、标签怎么算、算完存哪、怎么让推荐和运营系统用上。这门课就是拿一个完整的用户画像项目,把这条链路从头走一遍。 它解决的是什么工作场景 很多人在公司里接触到的画像工
会员可免费下载本篇月会员可按日额度下载(每篇扣 1 次)。
开通会员 ›会员 A · 按档位折扣
会员 B
游客按标价购买,不享受上表折扣。
支付成功后自动发放网盘链接,链接失效可找客服免费补
如果你在数据岗位或准备转行做数据开发,用户画像这个词大概率绕不开。它听起来像产品经理的活儿,实际落地时却是实打实的工程问题:埋点日志怎么收、标签怎么算、算完存哪、怎么让推荐和运营系统用上。这门课就是拿一个完整的用户画像项目,把这条链路从头走一遍。
它解决的是什么工作场景
很多人在公司里接触到的画像工作是被切碎的——有人只负责写 SQL 跑标签,有人只负责调接口取标签,没人讲清楚一张标签从原始行为日志到最终被业务调用,中间经过了哪些环节、每个环节容易出什么问题。这门课的价值在于把链路串起来:数据采集与清洗、离线计算、标签体系设计、存储选型、对外服务。你学完之后,面对"给运营做一批高价值用户名单"或者"给推荐系统提供实时特征"这类需求,至少知道该从哪一步下手,而不是只会接别人给好的宽表。
课程里涉及的技术组件偏工程侧,不是纯讲算法模型。这意味着它更适合想往数据开发、数仓、标签平台方向走的人,而不是只想学机器学习调参的人。
适合什么基础,建议先看哪几块
前提是你能写基本的 SQL,理解什么是分布式计算,最好碰过 Hadoop 生态里的某一两个组件。如果完全没接触过大数据,直接上手会比较吃力,因为课程节奏是按实战项目推进的,不会花大量篇幅补基础概念。
建议的观看顺序:先把标签体系设计和计算逻辑的部分看懂,这是整个项目的骨架,决定了后面存什么、怎么查。然后再看存储和查询环节,理解为什么某些标签要放宽表、某些要走 KV 查询。最后再看对外服务接口那部分,把前面算出来的东西真正用起来。采集和清洗部分如果时间紧,可以先跳过细节,遇到具体问题时再回头查。
学完能独立做什么,资料怎么配合练
比较现实的目标是:你能独立设计一套中小规模的标签体系,把业务方的需求翻译成可计算的指标,用离线任务跑出结果,并搭一个简单的查询接口供其他系统调用。这已经覆盖了多数公司画像岗位的日常。至于更复杂的实时画像、千万级 QPS 的特征服务,课程只是开了个头,需要你在实际项目里继续积累。
资料包按天组织,视频和配套文件放在一起。建议不要一口气刷完,每看完一个模块就自己动手把当天的代码跑一遍,尤其是标签计算那几段,换个数据集重新算一次,比看十遍视频管用。遇到环境或依赖问题,先自己排查,这类折腾本身就是工程能力的一部分。
如果你现在的工作里已经有画像相关的需求,但一直做得零散,这门课值得拿来当一次系统梳理;如果只是想了解概念,看看免费文章就够了,不必专门花时间。
课程目录
课程目录30 集
- ? day05_20201007 day05_20201007???.zip
- [1.8 MB] 28_????????????????????????????.mp4
- [34.4 MB] 24_????????????????????????????.wmv [25.5 MB] 05_????????????????????????.wmv [56.9 MB] 12_????????????HBase???????????Condition??????.wmv [56.3 MB] 23_??????????ALS?????.wmv [43.6 MB] 27_???????????????????????????.wmv [66.3 MB] 26_??????????????RDD ??API????.wmv [39.1 MB] 06_?????????????????????????????????????????.wmv [22.5 MB] 11_????????????HBase??????????????????????????????.wmv [48.5 MB] 13_????????????HBase???????????????????.wmv [73.9 MB] 08_??????????????.wmv [56.6 MB] 22_???????????????????????.wmv [29.3 MB] 19_????????????HBase??????????????.wmv [52.0 MB] 10_????????????HBase??HBase Filter???.wmv [39.8 MB] 03_????????????????????????????.wmv [32.3 MB] 18_????????????HBase??????WhereCondition????????????.wmv [52.9 MB] 09_????????????HBase??????????????????.wmv [20.7 MB] 04_????????????????????????????????????????.wmv [48.5 MB] 01_?????????????????????????HBase.mp4
- [65.0 MB] 14_????????????HBase???????????rule????WhereCondition???.wmv [27.1 MB] 02_??????????????????????????.wmv [32.3 MB] 07_??????????????????????????????????????????.wmv [9.0 MB] 15_????????????HBase?????????a????DateUtils.wmv [43.1 MB] 16_????????????HBase??????WhereCondition??????????????.wmv [32.1 MB] 20_??????????????????????????????.wmv [97.4 MB] 21_???????????????????.wmv [91.6 MB] 17_????????????HBase??????WhereCondition???????????.wmv [38.5 MB] 25_??????????????Maven Module.wmv [43.4 MB] ? day01_202009
- 25 t.zip
- [1.8 MB] 26_????????????????????????Hive??.mp4
- [19.5 MB] 17_?????WEB ?????????????.wmv [23.1 MB] 16_?????WEB ?????????(4???????.wmv [51.8 MB] 10_?????360?????????????????????????????.wmv [71.9 MB] 13_?????360???????????????????????.wmv [35.1 MB] 23_?????????????????ETL????.wmv [24.6 MB] 19_??????????????????????.wmv [14.7 MB] 02_?????360????????????????????????.wmv [46.3 MB] 05_?????360????????????????????????????.mp4
- [112.2 MB] 25_?????????????????Hive????????.wmv [43.1 MB] 12_?????360???????????????????????????.wmv [37.8 MB] 24_???????????????????????????????????.wmv [45.5 MB] 08_?????360????????????????????????.wmv [16.6 MB] 14_?????360??????????????????????????.wmv [41.8 MB] 03_?????360??????????????????????????.wmv [18.6 MB] 21_?????????????????????.wmv [119.0 MB] 01_?????Spark ???????????.mp4
- [17.5 MB] 09_?????360??????????????????????.wmv [49.0 MB] 04_?????360???????????????????????????????????.wmv [86.8 MB] 22_??????????????Project??Module.wmv [60.4 MB] 11_?????360????????????????????.wmv [24.6 MB] 06_?????360?????????????????????HBase??ES??.mp4
- [174.4 MB] 15_?????WEB ??????????????123???????.wmv [37.8 MB] 18_?????WEB ???????????????.wmv [20.8 MB] 07_?????360?????????????????????????????.wmv [51.3 MB] 20_????????????????????.wmv [32.6 MB] ? day06_20201009 day06_20201009???.zip
- [1.8 MB] 17_??????????????????????????????.wmv [67.2 MB] 15_???????????????????????????????.wmv [27.7 MB] 03_??????????????.wmv [16.2 MB] 02_??????????????????ALS.wmv [90.2 MB] 14_????????????????????????????????.wmv [39.5 MB] 12_???????????????????????????????????.wmv [88.7 MB] 08_?????????????????????.wmv [32.5 MB] 01_?????????????????????????HBase????????.mp4
- [51.3 MB] 11_?????????????????????????features???????.wmv [38.4 MB] 04_???????????AI??????????????????????.wmv [74.2 MB] 10_??????????????????????????label????????.wmv [53.8 MB] 06_???????????ML??????.wmv [66.1 MB] 16_?????????????????????????????.wmv [95.5 MB] 07_?????????????????????SK-Learn??SparkMLlib.wmv [45.8 MB] 18_????????????????????????????Sigmoid??????.mp4
- [35.2 MB] 13_???????????????????????.wmv [44.6 MB] 09_??????????????????????????????.wmv [78.6 MB] 05_???????????ML?????????????features.wmv [73.2 MB] ? day08_20201012 day08_20201012???.png [493.5 KB] 27_????????????PSM?????????????????.mp4
- [19.7 MB] 08_?????????RFM????????????????.wmv [49.2 MB] 15_???????????RFE?????????????????.wmv [71.3 MB] 04_?????????RFM?????????????????.wmv [45.3 MB] 01_?????????????????KMeans??.mp4
- [43.2 MB] 26_????????????PSM?????KMeans???????????.wmv [60.2 MB] 06_?????????RFM????????????????????.wmv [98.8 MB] 05_?????????RFM???????????.wmv [33.4 MB] 07_?????????RFM?????????????????????.wmv [64.0 MB] 09_?????????RFM?????????????????.wmv [121.6 MB] ???????+???????????.docx
- [88.8 KB] 10_?????????RFM???????????????????.wmv [21.2 MB] 22_????????????PSM?????KMeans????????????.wmv [39.2 MB] 25_????????????PSM??????PSM????????.wmv [74.3 MB] 17_???????????RFE??KMeans???????????.wmv [43.8 MB] 18_ID-Mapping???????????????????.wmv [40.7 MB] 19_ID-Mapping???????????????????.wmv [47.5 MB] 24_????????????PSM??????PSM???????.wmv [25.9 MB] 14_???????????RFE???????????????????RFE????.wmv [39.5 MB] 13_???????????RFE??????????????????.wmv [30.2 MB] 11_???????????RFE??????????????????????.wmv [35.2 MB] 16_???????????RFE?????????.wmv [38.3 MB] 12_???????????RFE??RFE??????????????.wmv [21.1 MB] 21_????????????PSM??PSM?????.wmv [36.4 MB] 02_??????????????????????RFM.wmv [55.8 MB] 20_????????????PSM??PSM????????.wmv [28.5 MB] 23_????????????PSM??????PSM???????.wmv [26.4 MB] 03_??????????????.wmv [18.8 MB] ? day03_20200928 day03_20200928????.png [493.5 KB] 35_?????????????????v??????SparkSession??????.wmv [40.4 MB] 21_??????????????????????????????????.wmv [18.1 MB] 25_???????????????????????????UDF????????.wmv [77.8 MB] 02_???????????????????????ETL.wmv [31.7 MB] 12_??????HBaseTools??read????????(????.wmv [37.7 MB] 14_??????HBaseTools??write?????????????.wmv [19.7 MB] 27_??????????????????????????????????????????.wmv [22.0 MB] 34_?????????????????v???????????????????.wmv [52.4 MB] 26_????????????????????????????????.wmv [22.2 MB] 30_?????????????????v?????????BasicModel??.wmv [18.9 MB] 03_?????????????????????????.wmv [29.5 MB] 23_?????????????????????????????.wmv [20.0 MB] 33_?????????????????????????????????????.wmv [64.3 MB] 19_????????????????????????????????????.wmv [17.8 MB] 04_??????????????????????????????.wmv [38.5 MB] 29_?????????????????v????????????Template??.wmv [8.4 MB] 17_???????????????????????HBase?????Meta???????????.wmv [36.7 MB] 24_???????????????????????????SparkSession??????Hive??.wmv [21.3 MB] 36_?????????????????v??Typesafe????????????.wmv [24.1 MB] 37_?????????????????v????????SparkUitls.wmv [57.2 MB] 08_??????????????????????????????????SparkSession??????.wmv [12.7 MB] 10_??????HBaseTools??read????????(???.wmv [53.0 MB] 32_?????????????????????????????????????????.wmv [23.4 MB] 38_?????????????????v????????????AbstractModel.wmv [24.1 MB] 05_??????????????.wmv [33.4 MB] 09_??????HBaseTools??????????????.wmv [27.9 MB] 39_?????????????????v???????????????.mp4
- [41.9 MB] 01_?????????????.mp4
- [18.8 MB] 13_??????HBaseTools??write????????????.wmv [32.4 MB] 06_?????????????????????????????????.wmv [10.6 MB] 22_?????????????????????????????.wmv [14.7 MB] 20_??????????????????????????????????????.wmv [30.2 MB] 18_??????????????????????????????.wmv [42.0 MB] 16_????????????????????????????????.wmv [29.8 MB] 07_???????????????????????????????4????5????.wmv [47.9 MB] 31_?????????????????v?????????BasicModel???????.wmv [31.4 MB] 11_??????HBaseTools??read????????(????.wmv [25.4 MB] 28_?????????????????v??????????????????.wmv [34.2 MB] 15_????????????????????????????????.wmv [40.5 MB] ? day09_20201014 day09_20201014????.png [493.5 KB] 13_?????????????USG????p????????????????.wmv [33.9 MB] 25_?????????????USG??CrossValidator??????.mp4
- [51.3 MB] 11_?????????????USG????????????????????????.wmv [64.9 MB] 08_?????????????USG?????????????????.wmv [51.9 MB] 09_?????????????USG??????????????ID3??C4.5??CART??.wmv [88.1 MB] 21_?????????????USG?????Pipeline???.wmv [71.3 MB] 12_?????????????USG????????.wmv [41.7 MB] 02_?????????????RFE??PSM???.wmv [36.0 MB] 17_?????????????USG?????????????????.wmv [75.7 MB] 06_?????????????USG??USG???????????????.wmv [57.3 MB] 24_?????????????USG??TrainValidationSplit??????.wmv [40.9 MB] 20_?????????????USG??Pipeline ???????.wmv [43.1 MB] 14_?????????????USG?????????????????????.wmv [21.6 MB] 18_?????????????USG??????????????????.wmv [42.0 MB] 01_?????????????????????.mp4
- [31.0 MB] 23_?????????????USG??????????????ParamGrid.wmv [11.7 MB] 03_??????????????.wmv [61.0 MB] 16_?????????????USG?????????????.wmv [93.5 MB] 15_?????????????USG???????????????WHEN???????.wmv [55.4 MB] 05_?????????????USG??USG??????????????.wmv [39.7 MB] 07_?????????????USG????????????.wmv [27.0 MB] 22_?????????????USG??????????????????????.wmv [34.3 MB] 19_?????????????USG??Pipeline??????.wmv [40.1 MB] 04_?????????????USG??USG??????????.wmv [27.6 MB] 10_?????????????USG???????????????????????.wmv [45.5 MB] ? day02_20200927 day02_20200927???.zip
- [1.8 MB] 17_??????????????????.wmv [15.7 MB] 23_??????????????????????????????.wmv [38.1 MB] 03_??????????????????????????.wmv [26.7 MB] 27_??????????????????????????.wmv [14.8 MB] 19_??????????????????????.wmv [7.9 MB] 25_?????????????????????????????.wmv [28.2 MB] 10_?????????????????BulkLoad?????????????Spark??.wmv [79.7 MB] 02_??????????????.wmv [21.0 MB] 26_???????????????????Module???????????.wmv [30.8 MB] 04_?????????????????SQOOP????HBase??.wmv [22.1 MB] 01_????????????.mp4
- [59.5 MB] 13_Oozie????Spark2?????Hue?????????????????????Spark2.wmv [50.2 MB] 14_Oozie Java Client API??????.wmv [58.6 MB] 07_?????????????????HBase ImportTvs??BulkLoad.wmv [53.1 MB] 11_???????????????.wmv [28.2 MB] 12_Oozie????Spark2?????Oozie???????????.wmv [38.5 MB] 21_??????????????????????.wmv [33.4 MB] 05_?????????????????HBase ImportTvs????logs????.wmv [52.6 MB] 20_?????????????l???????.wmv [33.4 MB] 15_Oozie Java Client API????Workflow.wmv [56.8 MB] 29_Spark ????HBase????????????.mp4
- [56.6 MB] 24_?????????????????????????????????????.wmv [39.0 MB] 08_?????????????????BulkLoad??????????????????.wmv [44.7 MB] 18_????????????????????.wmv [21.2 MB] 22_??????????????????????????Install??.wmv [55.3 MB] 06_?????????????????????????Put??BulkLoad.wmv [15.5 MB] 16_Oozie Java Client API????Coordinator.wmv [57.3 MB] 09_?????????????????BulkLoad?????????????MR??.wmv [85.2 MB] 28_????????????????????4????h.wmv [14.5 MB] ? day04_20200929 day04_20200929???.zip
- [1.8 MB] 34_????????????????????????????????????.mp4
- [38.1 MB] ?????? ??? ?? ??????.png [72.4 KB] 27_???????????????????????.wmv [54.7 MB] 18_????????????HBase???????????AbstractModel.wmv [38.5 MB] 11_????????????HBase??BaseRelation???.wmv [24.6 MB] 15_????????????HBase????????load?????????.wmv [50.4 MB] 14_????????????HBase????????load????????.wmv [36.7 MB] 22_???????????????????????????????????????.wmv [49.0 MB] 17_????????????HBase??????????.wmv [39.3 MB] 24_??????????????????????????????????????.wmv [57.7 MB] 23_?????????????????????????????????????.wmv [26.4 MB] 10_????????????HBase??External DataSource????.wmv [18.8 MB] 20_????????????????????.wmv [42.5 MB] 29_??????????????????????????????????????????????????.wmv [49.2 MB] 13_????????????HBase????????HBaseRelation??DefaultSource.wmv [32.3 MB] 25_????????????????????????????????.wmv [22.3 MB] 09_????????????HBase??????ExternalDataSource.wmv [44.2 MB] 28_??????????????????????????????????????.wmv [17.5 MB] 26_???????????????????????????????.wmv [45.0 MB] 04_??????????????????????.wmv [40.3 MB] 19_????????????HBase??Spark??HBase?????????????.wmv [28.1 MB] 33_????????????????????????????????????SQL??DSL??.wmv [57.6 MB] 12_????????????HBase??RelationProvider???.wmv [19.7 MB] 05_???????????????????????????????.wmv [39.0 MB] 06_???????????????????????????????????.wmv [32.8 MB] 21_?????????????????????????????????????????.wmv [47.2 MB] 02?????????????HBaseTools??????.wmv [34.9 MB] 03_???????????????????????????????.wmv [26.6 MB] 31_??????????????????????????????????.wmv [29.6 MB] 01_???????????????????????????.mp4
- [28.4 MB] 08_??????????????.wmv [23.9 MB] 07_?????????????????????????????????.wmv [13.8 MB] 16_????????????HBase????????save????.wmv [37.4 MB] 32_??????????????????????????????.wmv [41.8 MB] 30_???????????????????????????????.wmv [80.6 MB] ? day10_20201015 01_?????????????USG???????????.mp4
- [50.9 MB] 05_??????????Bagging??????????RF.wmv [64.6 MB] 23_?????????????BP??????????????HBase??.wmv [65.9 MB] 24_???????????????????.wmv [61.5 MB] 09_??????????????????????????????????.wmv [52.4 MB] 20_?????????????BP??????????????????.wmv [31.6 MB] 21_?????????????BP??????????????????????????????.wmv [44.9 MB] 12_?????????????????????HDFS?????HDFSMeta??.wmv [40.9 MB] 04_??????????Bagging????Boosting??.wmv [18.2 MB] 10_?????????????????????MySQL????MySQLMeta??.wmv [103.0 MB] 19_?????????????BP?????????????????????.wmv [28.6 MB] 02_????????????????Pipeline????????.wmv [59.7 MB] 07_??????????????.wmv [40.0 MB] 14_?????????????BP???????????.wmv [59.9 MB] 13_?????????????BP??Bp??????.wmv [9.9 MB] 08_????????????????????????????.wmv [24.5 MB] 22_?????????????BP??????ALS???????????????.wmv [118.3 MB] 11_?????????????????????Hive????HiveMeta??.wmv [40.3 MB] 16_????DataFrame API???????????????????????????????????.wmv [85.4 MB] 17_????DataFrame API???????????????????????????????.wmv [52.3 MB] 15_?????????????BP???????ALS.wmv [31.1 MB] 03_??????????Ensemble Algorithm????.wmv [37.7 MB] 18_?????????????BP??????????????????????????????.wmv [47.6 MB] 06_??????????Boosting ?????????????GBT.wmv [27.3 MB] 25_???????????????????.mp4
- [48.9 MB] ? day07_20201011 day07_20201011????.png [493.5 KB] 01_?????????????????????????????.mp4
- [44.9 MB] 20_?????????RFM??KMeans??????.wmv [64.2 MB] 24_?????????RFM??KMeans??2??????.wmv [62.3 MB] 18_?????????RFM??KMeans++??.wmv [19.5 MB] 09__?????????RFM??RFM??????.wmv [31.0 MB] 12_?????????RFM????????????????RFM.wmv [72.7 MB] 02_??????????????????????????.wmv [59.5 MB] 23_?????????RFM????????????????????.wmv [41.1 MB] 22_?????????RFM??????????????.wmv [101.1 MB] 16_?????????RFM??KMeans?????????????.wmv [92.9 MB] 27_?????????RFM??????????????????????K.mp4
- [71.2 MB] 14_?????????RFM?????????????.wmv [41.6 MB] 08_?????????RFM??RFM????..wmv [30.7 MB] 04_?????????????????????????????????CSV?????.wmv [17.3 MB] 21_?????????RFM?????????????.wmv [58.3 MB] 11_?????????RFM??????????????????.wmv [16.6 MB] 26_?????????RFM??KMeans?????????.wmv [37.1 MB] 07_??????????????.wmv [17.0 MB] 15_?????????RFM??KMeans?????????.wmv [54.4 MB] 19_?????????RFM??KMeansII??.wmv [21.5 MB] 05_????????????????????????????????.wmv [32.2 MB] 03_?????????????????????????????????????????.wmv [69.0 MB] 13_?????????RFM????????????RFM Score.wmv [34.2 MB] 25_?????????RFM??KMeans????????.wmv [15.3 MB] 06_????????????????????????LR???????????????.wmv [36.0 MB] 10_?????????RFM?????????????????.wmv [32.4 MB] 17_?????????RFM?????????????SSE.wmv [13.2 MB] 适合人群 大数据从业者 数据分析师 算法工程师 学习收获 掌握用户画像构建流程 熟悉大数据技术在推荐系统中的应用 提升数据挖掘与分析能力 祝您学习愉快! 学有所成,前程似锦!





