gpblog.com
robots.txt

Robots Exclusion Standard data for gpblog.com

Resource Scan

Scan Details

Site Domain gpblog.com
Base Domain gpblog.com
Scan Status Ok
Last Scan2025-12-28T23:08:28+00:00
Next Scan 2026-01-04T23:08:28+00:00

Last Scan

Scanned2025-12-28T23:08:28+00:00
URL https://gpblog.com/robots.txt
Redirect https://www.gpblog.com/robots.txt
Redirect Domain www.gpblog.com
Redirect Base gpblog.com
Domain IPs 104.26.12.37, 104.26.13.37, 172.67.71.99, 2606:4700:20::681a:c25, 2606:4700:20::681a:d25, 2606:4700:20::ac43:4763
Redirect IPs 104.26.12.37, 104.26.13.37, 172.67.71.99, 2606:4700:20::681a:c25, 2606:4700:20::681a:d25, 2606:4700:20::ac43:4763
Response IP 172.67.71.99
Found Yes
Hash ee1c15a81b8b7dda977518c0507a8a01036c33f77912460031f50fb04588a916
SimHash 04344ac7e5f5

Groups

*

Rule Path
Disallow /en/search
Disallow /nl/search

verity/1.1 (https://gumgum.com/verity; verity-support@gumgum.com)

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gpblog.com/nl/sitemap.xml
sitemap https://www.gpblog.com/en/sitemap.xml

Comments

  • Apply to all crawlers
  • Specific crawler rule for GumGum Verity