Systems with high loads on Linux
You can be able to work with different servers and software at different levels. There can be only one site at the capacity, but the number of requests to it can be so large that the hardware can no longer handle it. What to do in such a situation?
This course is for confident middle. We will teach you how to work with highly loaded servers so that they do not fall.
What do you need to take the course?
You need to be well versed in such topics: text editors, advanced user and group management in Linux, file and directory permissions management, process management, network configuration in Linux.
Iptables, proxy, troubleshooting for network connections, protocols for transferring data over the network, package managers, obtaining information about the versions of installed programs and packages available for installation in the repositories; web servers, DNS, database servers.
Web server and balancing of requestsLecture
Levels of balancing.Lecture
Algorithms and balancing methods.Lecture
Nginx web server.Lecture
Nginx module ngx_http_upstream_module.
Databases: high loadsLecture
The concept of replication and sharding in MySQL.Lecture
Types of replicationLecture
Clustering and Percona XtraDB Cluster. Parameters and directives in my.cnf, tuning Percona XtraDB ClusterPractice
Installation and configuration of Nginx web server. Practice on balancing setup skills using different algorithms based on Nginx with the ngx_http_upstream_module. Installation and configuration of Percona, combining nodes into a cluster, getting reports about the state of the cluster.
HAProxy and ProxySQLLecture
HAProxy tool, description and characteristics.Lecture
Configuration file of HAProxy, directives and receiving statements about backend nodes.Lecture
ProxySQL tool, description and characteristics.Lecture
The proxysql configuration file, commands for managing and receiving data.
Link aggregation. General rules for configuring EtherChannel.Lecture
Link Aggregation Control Protocol (LACP) in Linux.Lecture
LACP on Linux. Bonding and teaming.Lecture
Resilient IP based on the CARP (Common Address Redundancy Protocol) protocol.Practice
Installation and configuration of HAProxy as a frontend, configuration of balancing, configuration of the HAProxy control panel. Installation and configuration of proxysql, mysql queries balancing on 3 backend database servers. Installation and configuration of UCARP with distribution of IP to 3 servers.
DNS working principles. Architecture.Lecture
How DNS works. Root server system.Lecture
NS servers, bundles. Balancing by means of the DNS protocol.Lecture
CloudFlare service, tools, filters and DNS zone management.
Queue management systemsLecture
General information about queue management systems.Lecture
Apache Kafka. Terminology and components. Configuration files and directives.Lecture
Apache Kafka cluster.Lecture
RabbitMQ, terminology, commands for managing the server, commands for managing usersPractice
Installation and configuration of BIND, configuration of the master-slave link. DNS multiple A-records. Installation and configuration of Apache Kafka Cluster, practicing skills in creating and receiving messages.
Distributed file systemsLecture
The principle of operation of distributed file systems. Description and characteristics of popular distributed systems.Lecture
Description and technical characteristics of Ceph. Ways to implement fault tolerance and data storage in Ceph.Lecture
Description and technical characteristics of GlusterFS. Ways to implement fault tolerance and data storage in GlusterFS.
HA Storages, monitoringLecture
RAID Technology. Definitions and terminology.Lecture
RAID Levels. Composite RAID arrays.Lecture
Access to storage via NFS.Lecture
Monitoring systems, types and characteristics, selection of the optimal system for monitoring processes in HA infrastructures.Practice
Set up of a 1+0 Spanned RAID array using mdadm. Connection of the array via NFS. Configuration of triggers in Zabbix, channels monitoring and states of nodes on the internal network.
Project WorkExam Project
Have you already seen our courses?
You will definitely find what you need 😊
At the end of the course the student will know
- possible balancing algorithms that are applied to different technologies
- types of replication in database servers and the difference between them
- replication schemes
- configuration files and directives when building database clusters
- tools for balancing web, mail, sql
- principles of aggregation of network links in Linux
- the principle of operation of queue management systems in Linux
- algorithms of operation of distributed file systems
- levels of RAID arrays
- composition of RAID arrays
- methods of obtaining information about the state of highly loaded systems
At the end of the course the student will be able to
- configure the Nginx web server as a balancer using optimal balancing algorithms
- install and configure database replication
- configure Percona XtraDB Cluster with optimization of cluster settings
- configure HAProxy as a frontend server; install a control panel to monitor HAProxy balancing processes
- install and configure proxysql, provide balancing of SQL queries on several SQL servers
- install and configure floating IP (UCARP) with distribution to several servers
- install and configure master-slave links in BIND (named)
- install and configure Apache Kafka Cluster, create and receive messages from configured cluster