00:00 - 00:03 | Sir, I have some bad news for you |
00:04 - 00:05 | We have word from |
00:05 - 00:07 | the field that teams here |
00:08 - 00:12 | are not using dbt for |
00:12 - 00:15 | new data pipelines. |
00:17 - 00:19 | We'll lend resource |
00:19 - 00:21 | embed in their team |
00:24 - 00:26 | But sir, they're saying |
00:27 - 00:28 | this is priority A |
00:31 - 00:33 | Its true, word has it that |
00:34 - 00:36 | this has come straight from MB in QOF |
00:53 - 00:58 | They've not considered the impact on Redshift? |
01:13 - 01:15 | What about data cataloguing and observability. How will they solve that? |
01:15 - 01:17 | We keep working on the same business led |
01:18 - 01:23 | priorities, again and again |
01:25 - 01:28 | We dont have the foundations of good Data Engineering |
01:29 - 01:31 | We have Scala applications on EC2 that we struggle to patch |
01:31 - 01:34 | We have expensive streaming pipelines where a batch would suffice |
01:34 - 01:37 | We dont know who us using the data do we? |
01:37 - 01:40 | This Sales incident is an example of that |
01:40 - 01:42 | We're continually seeing people throw out an event |
01:42 - 01:46 | and we're not seeing them support the data products downstream of that |
01:46 - 01:48 | But we've not embedded with their team and offered support. |
01:48 - 01:52 | Offered support? |
01:53 - 01:54 | We have a team of 50 data engineers |
01:56 - 01:57 | We could do anything. |
01:57 - 02:00 | We have Kafka |
02:00 - 02:03 | DBT, a huge Redshift cluster |
02:04 - 02:08 | A cloud team, an infosec team. |
02:08 - 02:13 | Over 300 people in Tech alone. |
02:14 - 02:16 | This shouldnt be hard. |
02:17 - 02:21 | Why do the business not see the value in data? |
02:27 - 02:29 | We're supposed to be a tech company |
02:30 - 02:34 | Make data driven decisions |
02:34 - 02:36 | But all I see are fucking meerkats |
02:41 - 02:42 | MSM are coming for us |
02:43 - 02:47 | We cant take the money market without data |
02:48 - 02:53 | Gen AI |
02:54 - 02:56 | Dont get me started |
02:56 - 02:59 | You cant do ML, Data Science and magic things |
03:00 - 03:02 | if the data is shit |
03:04 - 03:07 | if you have no standards |
03:14 - 03:16 | no tooling |
03:19 - 03:23 | Fuck it |
03:25 - 03:26 | Lets just go to snowflake |
03:31 - 03:33 | We'll get a big consultancy to come in |
03:40 - 03:46 | lets migrate to Snowflake |
03:46 - 03:49 | I'm done |
03:53 - 03:56 | I'm becoming a marketing manager |