Hello dear friends.
Today I want to share a story from my life, what the Data Wharehouse (DWH) architecture looked like in “Tele2”, one of Russia’s largest mobile operators, before implementing EDW.
I joined the IT division of Tele2 in 2012 in the department of reporting systems. At that time, the company had already existed Wharehouse, on which many processes were already spinning to provide reporting and other processes.
A little about the technical stack used there at that time: the warehouse worked on Oracle database with RAM of 100TB, a T4–4 server with 1 TB storage. Data from various…
Big Data technologies are trendy today, as evidenced by at least the fact that, at the moment, it is one of the most frequently used terms in IT publications. It is enough to look at the statistics of such well-known search engines as Google or Yandex on the phrase “Big Data”. It becomes clear that the expression “Big Data” can now be called one of the most popular areas of information technology development.
So what is the secret of these technologies’ popularity, and what does the term “Big Data” mean? First of all, the name “Big Data” means a massive…
In discussions on work, I heard many stories about how bad it is to work in a particular project/company/industry, etc. Some of them are indeed valid. However, having gained quite a lot of experience working in companies and changing many projects and technology stacks, I have understood the problem and solution in different ways. We will talk about this.
When I hear complaints from employees about their dissatisfaction with their project (company/office/programming stack / etc.), I want to share my conclusions. Here they are:
We make choices in conditions of insufficient information.
Often in life, there might be situations when…
It is not a secret that in many companies, expenses on salaries of IT departments’ employees make up a significant part of the budget. And the high competition in the labor market further pushes the level of wages for IT specialists. High expenses lead to the fact that the employer is always searching for options to reduce their costs. It turned out, the companies themselves, trying to reduce costs as much as possible, turn to various tricks to reduce the cost of the work done. Similar mechanisms are used not only in IT but also in different other areas of…
by Mkrtich Pudeian
Data warehouse projects have long been part of the IT infrastructure of most large companies. ETL processes are part of these projects, but developers sometimes make the same mistakes when designing and maintaining these processes. Some of these mistakes are described in this post.
I would like to immediately narrow down the scope of the discussion and agree on terminology:
Здравствуйте, дорогие друзья.
Сегодня хочу поделиться историей из жизни, как было устроено хранилище DWH в Tele2 до внедрения КХД (EDW).
Поступил я в ИТ подразделение Tele2 в 2012 в отдел по системам отчетности. На тот момент в компании уже было создано хранилище DWH, на котором уже крутилось много процессов по предоставлению отчетности и не только.
Немного по поводу технического стека, который там использовался на тот момент. Для хранилища использовалась Оракловая база объемом 60–100 Тб сервер T4–4 c оперативой под 1 Тб. Туда загружались данные из различных источников. Но основными из них были 4 оракловые биллинговые базы, которые были по сути…
Data Wharehouse developer and Data analyst with 10 years experience