Multiple Networks on Linux

Issue

Because Linux has only one routing table out of the box, all replies originating from the host will go through the default route defined by the routing table. This is typically not the desired behavior since traffic from a secondary interface on a different network will be replied back on the primary interface.

Solution

The solution is to create a routing table for each additional interface.

For example:

# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000
    link/ether 00:0c:29:ea:92:46 brd ff:ff:ff:ff:ff:ff
    inet 136.159.5.40/24 brd 136.159.5.255 scope global dynamic eth0
       valid_lft 77336sec preferred_lft 77336sec
    inet6 fe80::20c:29ff:feea:9246/64 scope link
       valid_lft forever preferred_lft forever
3: ens36: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 00:0c:29:ea:92:50 brd ff:ff:ff:ff:ff:ff
    inet 172.17.12.253/24 brd 172.17.12.255 scope global dynamic ens36
       valid_lft 86108sec preferred_lft 86108sec
    inet6 fe80::6cb0:9a02:c755:15e5/64 scope link
       valid_lft forever preferred_lft forever
# echo "1 ens36" >> /etc/iproute2/rt_tables
# ip route add 172.17.12.0/24 dev ens36 src 172.17.12.253 table ens36
# ip route add default via 172.17.12.1 dev ens36 table ens36
# ip rule add from 172.17.12.253/32 table ens36
# ip rule add to 172.17.12.253/32 table ens36

To make this persistent, create a rule- and route- file under /etc/sysconfig/network-scripts.

If you're using a new-ish version of CentOS (7 & 8), you will also need to add NM_CONTROLLED=no to the ifcfg- file for these files to apply. You will also need the network-scripts package installed.

# cat /etc/sysconfig/network-scripts/rule-eno2
from 136.159.79.8/32 lookup eno2
to 136.159.79.8/32 lookup eno2

# cat /etc/sysconfig/network-scripts/route-eno2
136.159.79.0/24 dev eno2 table eno2
default via 136.159.79.1 dev eno2 table eno2

v t e Linux

Various Linux Notes	/etc/fstab Access.conf ACL Apache Proxy to Internal Server APM X-C1 (Mustang) ARP Authselect Bash Scripting Blockparser Booting Linux without a Graphics Card Building Container Images Burning CD/DVD in Linux Clear RAID Signatures on Linux Cobbler Colorized Terminal Outputs Compiling MIPS Configure Sendmail CPanel CPanel Fork Bomb Protection CPU Frequency Scaling Create a Linux User with an Empty Password Cron and PAM Issues Dell OpenManage Diff Two Command Outputs DirectAdmin Disable Filesystem Check on Startup DNS Ad Blocker Driver Disk Drop caches End / Home keys don't work in Terminal Entropy in the Linux Kernel Entropy Source using RTL-SDR Exit Codes Extract .exe Resources with dd File Attributes Fixing ixgbe unsupported SFP+ module type was detected Get Active Linux Virtual Console Getting Hardware UUID Hosts.deny How to change Linux desktop user directories How to hot-swap SATA disks on Linux HP Smart Storage Administrator Hyper-threading IBM Spectrum Archive IBM Spectrum Protect IBM Tape IBM Tape Diagnostic Tool InterWorx Kerberize NFS Kerberize SSH Linux Clustering Linux Fonts Linux Namespaces Linux Network Interface Naming Linux Nvidia Driver Linux Process Accounting Linux Uptime in Seconds Linux UTF-8 Font Mainline Kernel on CentOS 7 Missing Fonts Mod fastcgi Install on Apache 2 / cPanel Mod fcgid Monitoring network traffic in Linux Mounting / Unmounting KVM Image Mounting Samba (CIFS) shares Multiple Networks on Linux MySQL Database with Hash Sign No Console Output Number of Files Opened Open OnDemand Packing and unpacking initrd PAM Issues Partition Alignment Patching a binary file with dd Perl Module Location Raspberry Pi Red Hat kickstart Red Hat to Debian Reverse SSH Tunnel Ruby on Rails under cPanel Rutorrent + rtorrent Installation Guide on CentOS 6.4 Self Signed SSL Certificates Service Management Sick Beard StartSSL Free Certificate Symlink Taking a Screenshot in X11 Timezone Tor TOR Transparent Proxy Traefik Troubleshooting a Slow Linux System Turning on swap with a page file Udev Rules Verify SSL Certificate matches Private Key VMware Workstation Webcam X Display Manipulation X Forwarding

Linux Tools and Utilites	Anaconda Ansible Aria2 Autofs Awk Badblocks Bash Shell Binwalk Bosh Ceph Chntpw Chrony Clonezilla Cloud-init CloudStack Column Cron Curl Cvs2git Date Dbus Dd Dm-crypt Dovecot DRBD ElasticSearch Enroot Environment Module Envsubst Fail2ban FFmpeg Find Firecracker Flashrom Foreman FortiClient Fswebcam Galaxy Git Gnome Gobetween GPFS Grafana Grub Hdparm Home Assistant How to disable SELinux Htaccess Infiniband InfluxDB InfluxDB 1.x Insert a kickstart file into a iso image Inspircd IOzone Iperf3 Ipmitool Irqbalance John The Ripper Lightdm Lm sensors Logrotate LSF LVM Lynx Mailx Md5sum Mdadm Midnight Commander Motion Mount Mutt Nomad OpenLDAP Openocd OpenSSL OpenVPN Packer PHP Pi-hole Postgres PowerBroker Identity Service Proxmox Pueue PulseAudio Puppet Quota Red Hat Satellite Restic Rsync Rtorrent Ruby Sabnzbd Sage Samba Screen Sed SELinux Sendmail Shell Configs Singularity Sleep Slurm SMART Sonarr Sqlite SquashFS Squid SSH Steam Stoken Strace Sudo Sync Sysctl Syslog Sysrq System Security Services Daemon (SSSD) Systemd Tar Tcsh Telegraf Terraform Thttpd Tmux Tomcat Top Umask Unix2dos Vim Virsh Virt-customize VirtualBox VirtualGL Visidata Vnstat Weechat Wget XFS Youtube-dl ZFS Zram

Package Management	APT Pacman RPM Yum

Linux Distributions	Alpine Linux Arch Linux CentOS Fedora NixOS Red Hat Enterprise Linux Tails Tiny Core Linux Ubuntu

Networking	Blazemeter CSF/LFD Exim Firewall FreeIPA Get DHCP Network Settings IP Aliasing Ipset IPTables IPv6 IPXE Link Aggregation Linux Network Namespaces MTU Net-tools to iproute2 Netcat Open vSwitch OpenWRT Postfix Raspberry Pi Torified Wifi Socat Static Routes StrongSwan Tcpdump Traffic Forwarder using IPTables Wi-Fi WireGuard

Containers	Docker Docker Compose Docker Swarm Helm K3s Kibana Kubernetes Mailu PKS Podman

Multiple Networks on Linux

Issue

Solution

See Also

Recent Changes

Recent Changes under Linux

Recent Changes under Guides

Ad-Free + Tracker-Free