2019 FOSS4G Bucharest Talks speaker: Markus Neteler
From paper to pods: Revolutionised fibre planning process at Deutsche Telekom AG with FOSS4G components
Compared to other industrialised countries Germany ranks rather low when it comes to the availability of broadband internet via fibre. In order to change this and to cope with the needs for the new mobile standard 5G, Deutsche Telekom AG (DTAG) revolutionised the planning of fibre networks. The main goal is to shorten the time to market dramatically by automating processes. A brand-new world comprising lots of geodata and heavy geoprocessing is needed to substitute previous manual tasks.
The newly developed SDI shall respond to criteria, such as:
- Best of breed software
- Flexibility and adaptability
- Deployability via automated pipelines as well as scalability
- Sustaining a pluridisciplinary team working in an agile environment (SCRUM and SAFe)
DTAG selected open source components such as geOrchestra, SHOGun and Actinia to be deployed on a docker orchestration system. A large team of open source contributors were brought together to enable the launch of this major SDI.
This talk will present how FOSS4G components and teams can be effectively bundled together in order to achieve industry specific goals.
GRASS GIS in the cloud: actinia geoprocessing
Initially called GRaaS (GRASS as a Service), actinia has been developed to exploit GRASS GIS functionality via HTTPS REST API. GRASS locations, mapsets, vector and raster data as well as spatio-temporal data are available as resources to allow their management and visualization. With the existing (e.g. Landsat) and also recently emerging (Copernicus Sentinel) big geodata pools which are growing day by day, it is designed to follow the purpose of bringing algorithm to cloud geodata. It helps to prepare, analyse and provide a large amount of geoinformation without the need to have know-how of the data, of analysis, appropriate software (for automatisation) or scalable hardware resources.
Some of the features are persistent and ephemeral processing, user management to limit e.g. pixels, processes and duration of calculations as well as logging of API calls and used resources by each user. Another advantage is its easy deployment with docker. When deployed in a cloud based environment with OpenShift or docker-swarm, the integrated load balancer handles a cluster automatically.
Following the spirit of free and open software, we are proud to have emerged as an OSGeo community project and look forward to enlarge the actinia community.
How digging into the earth for the fibre roll-out took GRASS to the cloud
Deutsche Telekom AG (DTAG) revolutionises the planning process of fibre networks (FTTH) to
* increase number of connected households and industries dramatically, and
* shorten the time to market in general.
For this goal DTAG, advanced geoprocessing algorithms including artificial intelligence (AI) automate the conversion of surface information into cost optimised potential trenches used in the fibre build process. The surface information is gathered by terrestrial laser scanners and photos as well as extracted through a complex analysis from aerial orthophotos. This surface information then is used in conjunction with other (open) data as an input for the provisioning of potential trenches needed for FTTH. The processing of these orthophotos as well as the calculation of trenches are handled by the open source actinia cloud geoprocessing engine. Actinia is a new OSGeo community project, offering a REST API to GRASS GIS. The actinia processes are scaled and implemented as a service in the Open Telekom Cloud.
In this talk, we present the handling of large and complex input data in the FTTH-process. Focus is on the usage of actinia, and how actinia supports a core process of the largest German telecommunication provider.
When building, maintaining & continuously improving a SDI isn’t enough: DevOps processes to the rescue
Deutsche Telekom AG (DTAG) revolutionises the planning process of fibre networks in order to increase the number of connected households and industries dramatically as well as to shorten the time to market in general. A brand-new world comprising the build up of a major SDI, lots of geodata and heavy geoprocessing is needed to substitute previous manual tasks and to sustain the goals.
Think about a project, that will be developed by +10 companies, each with its own frameworks, procedures and deployment workflows. To succeed, you'll need more than confidence in the team. This is also because of other complicating factors like IT security, large data pipelines or ever-changing IT infrastructure.
This is where DevOps and AGILE practices came to the rescue. It gave a structure and a common understanding of the workflows to every project member, as well provided enough automation and flexibility to adjust to the constant changes the project undergone.
In this talk, we’ll present the key challenges and how DTAG and the team of the FTTH-Factory successfully implements agile and DevOps workflows for the project. If we’re brave, we’ll do DevOps on stage.
State of GRASS GIS Project: 35 years is nothing!
After 35 years of of continuous development, GRASS GIS comes again with great improvements. Being a community-driven project, it offers geospatial analysis, earth observation, time series processing and visualization. It supports large raster files (billions of cells), vector topology, and coupling with SQL databases.
In our presentation we'll give an overview of the latest improvements. The algorithms for interpolation, solar radiation, water flow, and sediment transport have been parallelized. Experimental features include concave hull, vector algebra, point cloud import, DEM fusion and blending, object-based classification, Sentinel data processing, and spatio-temporal algebra. Furthermore, pest spread and urban growth modeling are now available.
Importantly, Python 3 support has been added. Raster storage now benefits from new ZSTD compression. GRASS GIS supports GDAL up to v2.5 and PROJ up to v6. Easy cloud deployment is offered with ready-to-use docker images and an improved test coverage along with continuous integration.
The code development will move to GitHub, including the issues and source code branches since 1987. A new, modern website is on the way, supported by a crowdfunding campaign.