gobankingrates.com
robots.txt

Robots Exclusion Standard data for gobankingrates.com

Resource Scan

Scan Details

Site Domain gobankingrates.com
Base Domain gobankingrates.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-31T00:09:04+00:00
Next Scan 2026-05-01T00:09:04+00:00

Last Successful Scan

Scanned2025-01-06T19:49:44+00:00
URL https://gobankingrates.com/robots.txt
Redirect https://www.gobankingrates.com/robots.txt
Redirect Domain www.gobankingrates.com
Redirect Base gobankingrates.com
Domain IPs 108.138.199.21, 108.138.199.55, 108.138.199.56, 108.138.199.91
Redirect IPs 54.230.112.112, 54.230.112.126, 54.230.112.23, 54.230.112.9
Response IP 3.164.68.17
Found Yes
Hash 768b070e8c93ae252021f482bad6767b04c1dc30f8a81401d3b9eb83565f7453
SimHash fb77bd602120

Groups

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /email/*
Disallow /giveaway/*
Disallow /about/press-releases/*
Disallow /1035677/*
Disallow /edge/*
Disallow /feeds/*
Disallow /feed/*
Disallow /ecs/*
Disallow /tu/*
Disallow /tu-bff/*
Disallow /zip/*
Disallow /frontend/*
Disallow /backend/*
Disallow /bff/*
Disallow /wp-json/*
Disallow /static-redirect/*
Disallow /fp/*
Disallow /?attachment_id=*
Disallow /t/*

Other Records

Field Value
sitemap https://www.gobankingrates.com/wp-sitemap.xml
sitemap https://www.gobankingrates.com/sitemap-news.xml