openwrt-packages-dist/net/adblock/files

adblock script for openwrt

Description

A lot of people already use adblocker plugins within their desktop browsers, but what if you are using your (smart) phone, tablet, watch or any other wlan gadget...getting rid of annoying ads, trackers and other abuse sites (like facebook ;-) is simple: block them with your router. When the dns server on your router receives dns requests, you will sort out queries that ask for the resource records of ad servers and return the local ip address of your router and the internal web server delivers a transparent pixel instead.

Main Features

• support of the following domain blocklist sources (free for private usage, for commercial use please check their individual licenses):
  • adaway
  • => infrequent updates, approx. 400 entries (enabled by default)
  • disconnect
  • => numerous updates on the same day, approx. 6.500 entries (enabled by default)
  • dshield
  • => daily updates, approx. 4.500 entries
  • feodotracker
  • => daily updates, approx. 0-10 entries
  • malwaredomains
  • => daily updates, approx. 16.000 entries
  • malwaredomainlist
  • => daily updates, approx. 1.500 entries
  • openphish
  • => numerous updates on the same day, approx. 1.800 entries
  • palevotracker
  • => daily updates, approx. 15 entries
  • ruadlist/easylist
  • => weekly updates, approx. 2.000 entries
  • shallalist (categories "adv" "costtraps" "spyware" "tracker" "warez" enabled by default)
  • => daily updates, approx. 32.000 entries (a short description of all shallalist categories can be found online)
  • spam404
  • => infrequent updates, approx. 5.000 entries
  • sysctl/cameleon
  • => weekly updates, approx. 21.000 entries
  • whocares
  • => weekly updates, approx. 12.000 entries
  • winhelp
  • => infrequent updates, approx. 15.000 entries
  • yoyo
  • => weekly updates, approx. 2.500 entries (enabled by default)
  • zeustracker
  • => daily updates, approx. 440 entries
• zero-conf like automatic installation & setup, usually no manual changes needed (i.e. ip address, network devices etc.)
• full IPv4 and IPv6 support
• each blocklist source will be updated and processed separately
• timestamp check to download and process only updated adblock list sources
• overall duplicate removal in separate adblock lists (will be automatically disabled on low memory systems)
• adblock source list parsing by fast & flexible regex rulesets
• additional white- and blacklist support for manual overrides
• quality checks during & after update of adblock lists to ensure a reliable dnsmasq service
• basic adblock statistics via iptables packet counters for each chain
• status & error logging to stdout and syslog
• use a dynamic uhttpd instance as an adblock pixel server
• use dynamic iptables rulesets for adblock related redirects/rejects
• openwrt init system support (start/stop/restart/reload)
• hotplug support, the adblock start will be triggered by wan 'ifup' event
• optional: adblock list backup/restore (disabled by default)

Prerequisites

• openwrt, tested with latest stable release (Chaos Calmer 15.05) and with current trunk (Designated Driver > r47025)
• usual openwrt setup with 'iptables' & 'uhttpd', additional required software packages:
  • wget
  • optional: 'kmod-ipt-nat6' for IPv6 support
• the above dependencies and requirements will be checked during package installation & script runtime

Designated Driver Installation & Usage

• install the adblock package (opkg install adblock)
• start the adblock service with /etc/init.d/adblock start and check logread -e "adblock" for adblock related information
• optional: enable/disable your required adblock list sources in /etc/config/adblock - 'adaway', 'disconnect' and 'yoyo' are enabled by default
• optional: maintain the adblock service in luci under 'System => Startup'

LuCI adblock companion package

For easy management of the various blocklist sources and and the adblock options there is also a nice & efficient LuCI frontend available.
Please install the package 'luci-app-adblock' (opkg install luci-app-adblock). Then you will find the application in LuCI located under 'Services' menu.
Thanks to Hannu Nyman for this great adblock LuCI frontend!

Chaos Calmer installation notes

• currently the adblock package is not part of the CC package repository
• download the latest adblock package adblock_x.xx.x-1_all.ipk from a development snapshot package directory
• due to server hardware troubles the package directory link above may not work, if so please check the main openwrt download area manually
• manual transfer the package to your router and install the opkg package as usual

Tweaks

• there is no need to enable all blacklist sites at once, for normal use one to three adblock list sources should be sufficient
• if you really need to handle all blacklists at once add an usb stick or any other storage device to enlarge your temp directory with a swap partition => see openwrt wiki for further details
• add personal domain white- or blacklist entries as an additional blocklist source, one domain per line (wildcards & regex are not allowed!), by default both empty lists are located in /etc/adblock
• enable the backup/restore feature, to restore automatically the latest stable backup of your adblock lists in case of any (partial) processing error (i.e. a single blocklist source server is down). Please use an (external) solid partition and not your volatile router temp directory for this
• for a scheduled call of the adblock service via /etc/init.d/adblock start add an appropriate crontab entry
• in case of any script runtime errors, you should enable script debugging: for this please change the value of the main 'DEBUG' switch, you'll find it in the header of /usr/bin/adblock-update.sh

Further adblock config options

• usually the adblock autodetection works quite well and no manual config overrides are needed, all options apply to 'global' adblock config section:
  • adb_enabled => main switch to enable/disable adblock service (default: '1', enabled)
  • adb_cfgver => config version string (do not change!) - adblock checks this entry and automatically applies the current config, if none or an older revision was found.
  • adb_wanif => name of the logical wan interface (default: 'wan')
  • adb_lanif => name of the logical lan interface (default: 'lan')
  • adb_port => port of the adblock uhttpd instance (default: '65535')
  • adb_nullipv4 => IPv4 blackhole ip address (default: '192.0.2.1')
  • adb_nullipv6 => IPv6 blackhole ip address (default: '::ffff:c000:0201')
  • adb_forcedns => redirect all DNS queries to local dnsmasq resolver (default: '1', enabled)

Background

This adblock package is a dns/dnsmasq based adblock solution for openwrt.
Queries to ad/abuse domains are never forwarded and always replied with a local IP address which may be IPv4 or IPv6.
For that purpose adblock uses an ip address from the private 'TEST-NET-1' subnet (192.0.2.1 / ::ffff:c000:0201) by default.
Furthermore all ad/abuse queries will be filtered by ip(6)tables and redirected to internal adblock pixel server (in PREROUTING chain) or rejected (in FORWARD or OUTPUT chain).
All iptables and uhttpd related adblock additions are non-destructive, no hard-coded changes in 'firewall.user', 'uhttpd' config or any other openwrt related config files. There is no adblock background daemon running, the (scheduled) start of the adblock service keeps only the adblock lists up-to-date.

Support

Please join the adblock discussion in this openwrt forum thread or contact me by mail openwrt@brenken.org

Removal

• stop all adblock related services with /etc/init.d/adblock stop
• optional: remove the adblock package (opkg remove adblock)

Have fun!
Dirk