跳到主要內容

Install K8S on VM and spring boot integration.

Installation Environment Vmware Workstation pro  It is recommended to use the  snapshot  to store the state of each installation stage to avoid installation failures and causing the installation to start from scratch. Ubuntu 22.04 windows 11 Hardware settings  create 3 VM: 4 cores and 4G memory and 100G capacity Before installing K8s (All use the root user) set host: 192.168.47.135 master 192.168.47.131 node1 192.168.47.132 node2 set root ssh connection: sudo su - echo "PermitRootLogin yes" >> /etc/ssh/sshd_config systemctl restart sshd sudo passwd ssh-keygen for i in {master,node1,node2}; do  ssh-copy-id root@$i; done set Ipvs and conf  create conf file: for i in {master,node1,node2}; do ssh root@$i 'cat << EOF > /etc/modules-load.d/containerd.conf overlay br_netfilter EOF'; done execute conf: for i in {master,node1,node2}; do ssh root@$i 'modprobe overlay;modprobe br_netfilter;'; done create 99-kubernetes-cri.conf file: for i in {maste...

Concurrency

Glossary

  • Synchronous:  
    • When you start a program, you must wait until it finishes before moving on to the next step.
  • Asynchronous:
    • When you start a program, it returns immediately and runs the program in the background, and you can move on to the next step.
  • Concurrency:


    • Concurrency is the ability of different parts or units of a program, algorithm, or problem to be executed out-of-order or in the partial order, without affecting the final outcome
  • Parallelism:

    • Parallel computing is a type of computation in which many calculations or processes are carried out simultaneously.
  • Blocking:
    • A process that is blocked is one that is waiting for some event, such as a resource becoming available or the completion of an I/O operation
  • Non-blocking:
    • An algorithm is called non-blocking if the failure or suspension of any thread cannot cause the failure or suspension of another thread

Concurrency level

  • Blocking:
    • A thread is blocked and it cannot execute until other threads release resources.
  • Starvation-Free:
    • Resource allocation is fair to all threads.
  • Obstruction-Free:
    • A method is obstruction-free if, from any point after which it executes in isolation, it finishes in a finite number of steps (method call executes in isolation if no other threads take steps).
  • Lock-Free:
    • A method is lock-free if it guarantees that infinitely often some method call finishes in a finite number of steps.
  • Wait-Free:
    • A method is wait-free if it guarantees that every call finishes its execution in a finite number of steps.

Concurrency concept

  • Atomicity:
    • Atomicity means that an operation is non-interruptible. Even when multiple threads are executed together, the operation will not be disturbed by other threads once it is started. That is, an atomic operation is a small operation.
  • Visibility:
    • Visibility is when a thread modifies the value of a shared variable, and whether another thread can immediately know the change.
  • Ordering:
    • When it comes to ordering, it inevitably has a disorderly order, which is caused by the JVM's command rearrangement optimization.
    • If we want to keep order completely, we need to add a synchronous lock (synchronized) to the object, which is actually a single thread execution.

Concurrency programming optimization

  • Use thread pools to reduce thread creation costs.
  • Use concurrent package tools.
  • Use immutable variables or do not share resources.
  • Suggestions to improve lock performance:
    • Reduce lock-holding time.
    • Reduce lock granularity.
    • Read-write separation lock to replace the exclusive lock.
    • Lock separation.
    • Lock coarsening (reduce lock requests).

reference:

留言

這個網誌中的熱門文章

GC Basic Algorithm

Theory Most GCs follow the theory of generational collection, which is based on the following two: Week generational hypothesis:  Most of the objects are short-living. Strong generational hypothesis:  The more times an object survives GC, the harder it is to die. Mark-Sweep After the marking phase has been completed all space occupied by unvisited objects is considered free and can thus be reused to allocate new objects. There may exist plenty of free regions but if no single region is large enough to accommodate the allocation, the allocation is still going to fail. Mark-Copy To avoid excessive fragmentation, it splits the space into two parts and copies the surviving objects into empty parts. The disadvantage is the need for one more memory region, which should be large enough to accommodate survived objects. Mark-Compact Like mark-copy, it doesn't require another space to copy but a more complex operation to move the object. Reachability analysis First, GC defines some spe...

OS basic

Table of contents [ hide ] OS architecture The operating system architecture consists of three parts, user mode, kernel mode, and hardware. User mode is for the application to execute the user's program. Kernel mode is to control all the I/O devices and system stability. Storage device hierarchy System call The system call is a kind of software interrupt, including six categories. Process control. File management. Device management. Information maintenance. Communication. Protection. System calls use three methods to pass parameters. Registers. The table in memory. Push onto the stack. A view of operating system services reference: https://www.amazon.com/-/zh_TW/Operating-System-Concepts-Abraham-Silberschatz/dp/1119800366/ref=sr_1_1?keywords=Operating-System-Concepts&qid=1669538704&s=books&sr=1-1

Thread and concurrency

Table of contents [ hide ] Thread Thread is a lightweight process, a basic unit of CPU utilization. All threads belonging to the same process share: Code section. Data section. OS resources(e.g. open files and signals) Each thread has its own(thread control block): Thread ID. Program counter. Register set. A tack. Benefits of multithreading: Responsiveness. Resource sharing. Utilization of NP arch. Economy. User vs Kernel threads User threads Thread management is done by the user-level thread library. POSIX Pthreads. Win32 threads. Java threads. Thread library provides support for thread creation, scheduling, and deletion. Generally fast to create and manage. If the kernel is single-threaded, a user-thread block -> entire process blocks even if other threads are ready to run. Kernel threads Supported by the kernel(OS) directly. Windows 2000(NT) Solaris Linux Tr64 UNIX The kernel performs thread creation, scheduling, etc. Generally slower to create and manage. If a thread is blo...