现代数据架构课程-哥伦比亚大学课程学习笔记
这是当年念书的时候记录的学习笔记,感觉还是非常稚嫩,而且基本都是框架性质的东西,看个热闹吧哈哈哈哈哈哈哈。
Modern Data Architecture Learning Journal
1.1 Software Development Life Cycle.
According to the description from The Business Analyst’s Handbook, Software Development Life Cycle has generally five stages of Initiation, Discovery, Construction, Final V&V and Closeout. This structure has a lot in common with the structure of method called “Project Management Life Cycle”, which is wildly applied during my working period. To be specific, the methodologies called Scrum and Waterfall are also developed based on the basic software and project management life cycle with essential parts stressed more.
1.2 Architecture to connect business and technology sides.
(相关资料图)
The architecture of the modern data base will be the glue bridging the gap between the two sides. Architecture unites Tech&Biz based on four layers:
Presentation(change management); Logic(insights, process and projects); Data; Sources of data
When I was working in a huge drink manufacturing and marketing organization, the IT department is sharpening the big data platform for the vending machines sales information.We have the source of data, the data itself, the next step is to go up to convert data into insights and projects, and finally to support the change of business, organization or management flow, as what I did as the project manager. This is the internal consulting process which starts from the source to presentation. External consulting projects, generally speaking, starts with the problem and the top of the four layers and walk down to the sources of data for quantitative solution.
1.3 Data Lake and Data Warehouse.
Apparently Data Lake, as the platform to support hybrid of structured and unstructured data, is growing in data industry with great advantage such as processing speed, storage convenience and agility of application with security. Conceding the traditional data warehouse has been playing the role of infrastructure in the industry, the innovation and replacement brought by data lake would not happen until ROI become significant for both medium and long term development at least.
1.4 ROI
If we area talking about the data application and it final outcome for different business, organizations and projects, a measurable metric or KPI will be significant for the evaluation. ROI, return on investment, would be a general number used to conduct the evaluation. Financially speaking, Return on Investment = (Profit/Savings from Investment – Cost of Investment) / Cost of Investment. On technical side, the number has flexibility on calculation. We can either focus on the improved efficiency with (Delta – Mod – BI)/KPI or we have ROI = (Delta – (Mod + BI)) / BI.
For Future Application
In the future of my career life, in which I plan to be a quantitative expert in marking and operation areas, the application of data mining, data architecture, and database should always focus on the four layers of Presentation(change management), Logic(insights, process and projects), Data and Sources of data. Lines of business, shared services, enterprises level application, these three factors play as initiator, enabler and barrier on all four layers. The three roles of initiator, enabler and barrier should play the guiding principles for my professionalism in related industries to inspire and maintain my
Group Project
Currently the group project focuses on business requirements, and what we have built for the project are the drivers, motivation and criteria of the project in business areas mainly. We also learned that today the control of technology is shared among a variety of participants, which should be demonstrated in our group project. The architecture of data should be the glue to bridge the gap between the business and technique sides.
In the business req document, at least we need to demonstrate the clarity of opportunity/problem/purpose, ensure the completeness to include a description of the anticipated user group, anticipated usage, data volume, up-time requirements, and high-level functionality, and the establish the success criteria/vocabulary that can be objectively measured. The criteria is stated in clear, unambiguous terms that can be understood by both the business and the tech sides.
To be more specific about the criteria, we need to have anticipated user group, anticipated usage, data volume, up-time requirements, and high-level functionality. Up-time requirements refers to the total amount of time that the system is available for end-use applications. The value is stated as a percent of total scheduled working hours.
These are the uptime percentages and corresponding downtime values for customers that must be available all the time (24×365).
•Less than 90% (downtime of 876 or more hours (36 days)/year)
•90 to 95% (downtime of 438 to 876 hours/year)
•95 to 99% (downtime of 88 to 438 hours/year)
•99.1 to 99.9% (downtime of 8.8 to 88 hours/year)
•99.99% (downtime of about 50 minutes/year)
•99.999% (downtime of about 5 minutes/year)
Typically the cost per outage hour is used as a determining factor in up-time requirements. When talking about unplanned outages, the uptime requirements must be based only off of the scheduled working hours. This means the cost of an outage should be calculated based on the worst possible time.
Emerging Technologies
4.1 Big data and six sigma
The core of Six Sigma is a philosophy and focus for reducing variability in process operations. It involves process definition and the incorporation of an array of statistical analytic methods to measure the performance of various attributes
Big data is not the problem of size, the real problem is the big deal. Which means the gap between the the ways you want to manipulate the data and the limited ways the data present itself. In DMAIC model of 6sigma, the big data grants us more perspectives and methods to evaluate operation issues.
4.2 Social Medias like Twitter and Facebook
We know that funds companies like TwoSigma is use Twitter to conduce sentiment analysis for stock market. Facebook has the ability to tell when customers might be in couple and when they might breakup. Social medias grants data mining the approaches to the analysis or customized and personal life.
本文使用 文章同步助手 同步
标签:
- 现代数据架构课程-哥伦比亚大学课程学习笔记
- 当前讯息:英汉生物化学及分子生物学词典·续编_关于英汉生物化学及分子生物学词典·续编的简介
- 乔帅观战!领头羊逆转联盟第4,20岁小将砍15+10,强援空砍32+21|当前关注
- 国产混动suv哪款最值得买(混动最好的10款车合资suv)|环球观速讯
- 女子开车数公里陪伴走失男童,找到其家人后爷爷哽咽感谢 当前热点
- 2023年03月28日炒股养家现身汇源通信
- 【天天时快讯】3月28日龙虎榜:2.57亿抢筹四川长虹 机构净买15股
- 唐三婚前婚后差异明显,手的位置越来越“放肆”,救人还不忘摸脸 环球头条
- 环球速递!建房工地合同范本(通用4篇)
- 厦门象屿608.71万股限制性股票预留授予条件已达成 价格为5.36元/股
- 河南省疾控中心专家组对漯河市麻疹和AFP病例监测工作进行技术指导_全球热闻
- 看热讯:晋中开发区农商银行张丽丽:小小柜台里 大大服务经
- 兆龙互连: 目前在光伏储能新能源领域已与国内知名企业展开合作
- 【热闻】粘豆包隔夜还能吃吗?粘豆包隔夜怎么保鲜
- 长街宴歌词(长街宴)_当前动态
- 当前速读:家长课堂主题文案_家长课堂主题
- 中国银保监会2023年公务员考试面试确认及资格复审_全球快消息
- 我省县区级首例 二手房“带押过户”落地-环球焦点
- 玻璃胶多长时间能凝固(玻璃胶多长时间能干)_今日讯
- 环球热议:重庆工程职业技术学院学子在“中国银行杯”2023年重庆市职业院校技能大赛工程测量赛项中获一等奖
- “食安交院.评美食”第一届校园美食节活动圆满成功
- 吴和为什么要离婚?
- 3月28日 奥斯梅恩曾到尤文更衣室找C罗要球衣;... 最新资讯
- 报道:“00后”民警跳湖救起轻生男子
- 034期韩菲双色球预测奖号:单挑6+1参考
- 安卓手机如何破解密码_手机如何破解密码
- 武汉农村商业银行登录密码_武汉农村商业银行登录
- 天天热门:信用卡逾期找律师有用吗?信用卡逾期利息多少钱?_天天微资讯
- 今日热门!首次!实现固态氢能发电并网了!
- 腾讯手游助手缺少atl80.dll_腾讯手游助手缺少atl80-世界今日讯
- 中国式现代化河北场景·一线丨临港产业 活力迸发_世界观察
- 韩城市属于哪个市的_韩城市属于哪个市 全球观天下
- 全球最新:95号汽油或将重回“7元时代”事件简单介绍
- 中国第一部动画片叫什么名字_中国第一部动画片_今日热文
- 天天热点!英超裁判安排:胡珀执法第29轮曼城红军 泰勒执法红军蓝军补赛
- 米非司酮片副作用_米非司酮片多少钱一盒
- 3月27日21时四川雅安疫情最新公布数据及雅安最新疫情共多少确诊人数 头条
- 教授在退休之际设立奖学金,一个月之后“奖池”膨胀了4倍
- 【时快讯】环幕景观阳台、主卧落地窗!南京户型竟然卷成这样!
- 世界球精选!三未信安: 关于2022年年度利润分配及公积金转增股本方案的公告
- 我为群众办实事|雅荷四季城H3号楼电梯频繁故障 物业:维修完毕 每日动态
- 乡村振兴看伊川:恰趁春潮向振兴【视频】
- 重启六大品牌体育赛事、设立专项支持资金……海南出台10条措施振兴文体会展活动
- 上海去年常住人口为2475.89万人,60岁及以上占比25% 当前快讯
- 环球快看:重庆数十家菜鸟驿站试点上线绿色回收IOT扫码设备
- 长武县彭公镇“四抓四促”推动干部能力作风“双提升” 当前报道
- 上游高盈利但炼油与化工承压,中国石化去年净利润下滑近7%
- 和讯个股快报:2023年03月27日 格灵深瞳-U (688207),该股突破长期盘整-环球热闻
- 每日看点!如何给汽车打蜡效果好(怎么给汽车打蜡 汽车打蜡的正确步骤)
- 世界热点评!红心向党 科技筑梦 二七区政通路小学举行全国青少年红色主题模型、航海模型教育竞赛活动
- 世界看热讯:长城人寿荣膺“年度金牌创新力金融机构”
- 贝弗利朝湖人观众席爆粗庆祝:对阵老詹胜率前三 疯狂嘲讽前东家_天天即时看
- 王熠_关于王熠介绍
- 2020年大众帕萨特
- 协鑫能科拟出售5家热电项目公司部分股权 有助于优化资本结构、提升发电资产盈利能力
- “七办”促车管所服务大提速 全球最新
- 当前资讯!国家法定假日多少天(国庆法定假期是几天)
- 当前讯息:新浪微博短链分析是什么?
- 有关歌颂党的七言诗_歌颂祖国的七言诗
- 环球关注:劳动合同法第四十一条第一款规定_劳动合同法第四十一条
- 魔装学园出了几季_魔装学园hxh第二季什么时候播出
- 什么是作业成本法最基本的概念_什么是作业成本法
- 重回箱体震荡,下周该如何操作?
- 全球短讯!王灵镇_关于王灵镇介绍
- 天天最新:西部附加赛惨烈5抢4:湖人前六概率仅两成 恐被一队提前放弃坑惨
- 天天观速讯丨朱民:中国5%的经济增长目标是非常审慎和可持续的,对全球都是有益的
- 为什么三角形内角和等于180度_一个多边形的内角和等于1260_实时焦点
- 吉木萨尔县区号是多少_吉木萨尔县属于哪个是哪个区_天天新资讯
- 双大腿酸胀难受是咋回事啊_小腿酸胀是怎么回事
- 单警装备有哪些
- due是什么意思|环球观速讯
- 纯爱战神新海诚,在中国“暴打“漫威DC
- 天天微速讯:领克08正式亮相 定位中型SUV/豪华质感相当出色
- 动态焦点:感动中国年度人物事迹材料精选7篇
- 环球热消息:去三亚要准备什么东西_去三亚要准备带什么东西
- 普京:同意美记者关于美情报机构参与破坏“北溪”管道的结论
- Java中restTemplate的使用
- 观察:科威特货币是什么
- 空开跳闸最常见原因及处理方法_空开跳闸最常见原因
- 马拉色菌是怎么来的_马拉色菌|全球观点
- 2015年5月20日黄历
- qq拼音输入法_qqpy
- 节水护水,上海这个村三代人与水结缘
- 姐妹情深的短句子大全(姐妹情深的短句) 世界滚动
- 校园电视剧青春偶像2019(校园电视剧青春偶像2020)
- 快看点丨这些广告禁止发布!互联网广告新规5月起施行
- 益生股份:公司目前正在大力发展种猪产业
- 饥饿游戏结局
- 【独家焦点】过的组词有哪些 过组词大全690个
- 全球速讯:阿布扎比国家石油公司拟6月将海运物流子公司IPO
- 江西提前入汛:预计今年旱涝并存,形势依然严峻复杂
- 天天热头条丨租来的400万钢管转手卖废铁?一男子合同诈骗获刑十年六个月
- java图书管理系统展示_java图书管理系统_天天快看
- 开放再发力 世界如何共享中国新机遇 全球新消息
- 这几个小改变,就能让你睡个好觉!|世界睡眠日
- 大波浪是什么发型 全球百事通
- 暴露的近义词是什么
- 百舸争流 竞逐深圳大亚湾
- 卢卡因对裁判做出数钱动作被罚款3.5万美元_天天最新
- 新资讯:《命运2 》老九 23/03/25丨下周大师梦魇+传说战场