Proxmox: Difference between revisions

Revision as of 22:32, 29 December 2021

Proxmox Virtual Environment (VE) is an open source virtualization management software that allows deployment and management of KVM-based virtual machines and LXC containers. The platform itself run on a Debian based distribution and supports filesystems such as ZFS and Ceph.

In terms of functionality, Proxmox VE is similar to VMware ESXi with some overlap with vSphere. You can have a cluster of Proxmox servers controlled and managed through a singular web console, command line tools, or via the provided REST API.

Installation

Installation is as simple as installing any other Linux distribution. Download the Proxmox iso image from https://www.proxmox.com/en/downloads. After installation, you should be able to access the web console via HTTPS on port 8006.

Tasks

Remove the subscription nag

If your Proxmox server has no active subscription, you will be nagged every time you log in to the web interface. This can be disabled by running the following as root in the server's console:

sed -Ezi.bak "s/(Ext.Msg.show\(\{\s+title: gettext\('No valid sub)/void\(\{ \/\/\1/g" /usr/share/javascript/proxmox-widget-toolkit/proxmoxlib.js

Make a VM automatically start at boot

You can enable or disable a VM from starting with the Proxmox host as well as configure the order in which VMs are started.

The setting is located under the VM or container's 'Options' pane.

Adding additional LXC templates

Proxmox officially supports about a dozen different Linux distributions and provides up to date LXC templates through their repositories. These LXC templates can be downloaded using the pveam tool or through the Proxmox web interface.

Web interface

Go to your local storage and click on CT Templates. Click on the Templates button to see available templates.

pveam tool

Run pveam available to list all available templates, then run pveadm download $storage $template to download a template to a storage pool.

root@server:~# pveam available
mail            proxmox-mailgateway-6.4-standard_6.4-1_amd64.tar.gz
mail            proxmox-mailgateway-7.0-standard_7.0-1_amd64.tar.gz
system          almalinux-8-default_20210928_amd64.tar.xz
system          alpine-3.12-default_20200823_amd64.tar.xz
system          alpine-3.13-default_20210419_amd64.tar.xz
system          alpine-3.14-default_20210623_amd64.tar.xz
system          alpine-3.15-default_20211202_amd64.tar.xz
system          archlinux-base_20210420-1_amd64.tar.gz

root@server:~# pveam download local fedora-35-default_20211111_amd64.tar.xz
downloading http://download.proxmox.com/images/system/fedora-35-default_20211111_amd64.tar.xz to /var/lib/vz/template/cache/fedora-35-default_20211111_amd64.tar.xz
--2021-12-29 15:17:28--  http://download.proxmox.com/images/system/fedora-35-default_20211111_amd64.tar.xz
Resolving download.proxmox.com (download.proxmox.com)... 144.217.225.162, 2607:5300:203:7dc2::162
Connecting to download.proxmox.com (download.proxmox.com)|144.217.225.162|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 89702020 (86M) [application/octet-stream]
Saving to: '/var/lib/vz/template/cache/fedora-35-default_20211111_amd64.tar.xz.tmp.1053836'
     0K ........ ........ ........ ........ 37% 2.59M 21s
 32768K ........ ........ ........ ........ 74% 13.6M 5s
 65536K ........ ........ .....            100% 20.5M=16s
2021-12-29 15:17:44 (5.42 MB/s) - '/var/lib/vz/template/cache/fedora-35-default_20211111_amd64.tar.xz.tmp.1053836' saved [89702020/89702020]
calculating checksum...OK, checksum verified
download of 'http://download.proxmox.com/images/system/fedora-35-default_20211111_amd64.tar.xz' to '/var/lib/vz/template/cache/fedora-35-default_20211111_amd64.tar.xz' finished

Integrating Terraform with Proxmox

You can use Terraform to manage VMs on Proxmox. More information on how to set this up on the Terraform page.

Troubleshooting

LXC containers does not start networking

I have a Fedora based LXC container which takes a long time to start up. After the tty does start, the only network adapter isn't up. systemd-networkd is also in a a failed state with a bad exit code and status 226/namespace.

This was resolved by enabling nesting on this container with the following commands:

# pct set $CTID -features nesting=1 
# pct reboot $CTID

@@ Line 21: / Line 21: @@
 [[File:Proxmox start VM at boot.png|alt=Proxmox start VM or container at boot|none|thumb|Proxmox start VM or container at boot]]
-=== Adding additional LXC templates ===
+===Adding additional LXC templates===
 Proxmox officially supports about a dozen different Linux distributions and provides up to date LXC templates through their repositories. These LXC templates can be downloaded using the pveam tool or through the Proxmox web interface.
-==== Web interface ====
+====Web interface====
 [[File:Proxmox CT Templates.png|alt=Download additional Proxmox CT Templates via the web interface|thumb|Download additional Proxmox CT Templates via the web interface]]
 Go to your local storage and click on CT Templates. Click on the Templates button to see available templates.
-==== pveam tool ====
+====pveam tool====
 Run <code>pveam available</code> to list all available templates, then run <code>pveadm download $storage $template</code> to download a template to a storage pool.
 {{Highlight
@@ Line 58: / Line 58: @@
 }}
-===Deployment using Terraform===
+=== Integrating Terraform with Proxmox ===
-You can use Hashicorp's Terraform deployment tool to automatically provision virtual machines on Proxmox. After installing Terraform, follow the following steps to get your deployments working.
+You can use Terraform to manage VMs on Proxmox. More information on how to set this up on the [[Terraform]] page.
-====Setup Terraform====
-Terraform controls the Proxmox server using the [https://github.com/Telmate/terraform-provider-proxmox Telmate Proxmox provider]. For more information on each of the provider's options, review the documentation at https://registry.terraform.io/providers/Telmate/proxmox/latest/docs/resources/vm_qemu.
-To quickly get started, we will:
-#Install Terraform
-#Setup an account with an API key on Proxmox. This account should have permissions to '/' as well as to any storage volumes it needs to create VMs on '/storage/data'. (TBD)
-#We will use the following <code>main.tf</code> file which will define the provider and provider configurations. The VM definitions are also included here.
-#Run <code>terraform init</code> to set up the provider
-#Run <code>terraform plan</code> to plan the tasks
-#Run <code>terraform apply</code> to create the VMs.
-main.tf:{{Highlight
-| code = # Use Telmate proxmox provider
-terraform {
-  required_providers {
-    proxmox = {
-      source = "telmate/proxmox"
-      version = "2.7.4"
-    }
-  }
-}
-# Configure the proxmox provider
-provider "proxmox" {
-  pm_api_url = "https://proxox-server:8006/api2/json"
-  pm_api_token_id = "terraform@pam!terraform_token_id"
-  pm_api_token_secret = "e458e7bc-d8e6-4028-885b-d0896f4becfa"
-  pm_tls_insecure = true
-}
-# Define our first VM
-resource "proxmox_vm_qemu" "test-vm" {
-  count = 1                            # 0 will destroy the VM
-  name = "test-vm-${count.index + 1}"  # count.index starts at 0. We want the VM to be named test-vm-1
-  target_node = var.proxmox_host       # target proxmox host
-  clone = var.template_name            # VM template to clone from
-  os_type = "cloud-init"
-  agent = 1
-  cores = 2
-  sockets = 1
-  cpu = "host"
-  memory = 2048
-  scsihw = "virtio-scsi-pci"
-  bootdisk = "sata0"
-  disk {
-    slot = 0
-    size = "10G"
-    type = "sata"
-    storage = "data"
-    iothread = 1
-  }
-  network {
-    model = "virtio"
-    bridge = "vmbr0"
-  }
-  lifecycle {
-    ignore_changes = [
-      network,
-    ]
-  }
-  ipconfig0 = "ip=10.1.1.10${count.index + 1}/22,gw=10.1.1.1"
-  # sshkeys set using variables. the variable contains the text of the key.
-  sshkeys = <<EOF
-  ${var.ssh_key}
-  EOF
-}
-| lang = text
-}}vars.tf:
-{{Highlight
-| code = variable "ssh_key" {
-  default = "ssh-rsa  ... "
-}
-# This should be the exact same name as your proxmox node name
-variable "proxmox_host" {
-	default = "proxmox-server"
-}
-variable "template_name" {
-	default = "rocky85-template"
-}
-| lang = text
-}}
-====Issues with the apply step====
-I kept on getting "<code>400 Parameter verification failed</code>":
-{{Highlight
-| code = ╷
-│ Error: 400 Parameter verification failed.
-│
-│   with proxmox_vm_qemu.test-vm[0],
-│   on main.tf line 20, in resource "proxmox_vm_qemu" "test-vm":
-│   20: resource "proxmox_vm_qemu" "test-vm" {
-│
-╵
-| lang = text
-}}
-The issues I encountered which triggered this error was:
-*Incorrect host name for the Proxmox node
-*Invalid values for the disk type (I tried changing <code>type = "scsi"</code> to <code>type = "sata"</code>) while leaving <code>iothread = 1</code> defined.
-To help diagnose issues, review the provider's documentation and ensure the values you're using are appropriate. You may also want to enable additional logging by running with the <code>TF_LOG=TRACE</code> environment variable:
-{{Highlight
-| code = $ TF_LOG=TRACE terraform apply
-| lang = terminal
-}}
 ==Troubleshooting==
 ===LXC containers does not start networking===
 I have a Fedora based LXC container which takes a long time to start up. After the tty does start, the only network adapter isn't up. <code>systemd-networkd</code> is also in a a failed state with a bad exit code and status <code>226/namespace</code>.