ia.postcodebase.com
robots.txt
Robots Exclusion Standard data for ia.postcodebase.com
Resource Scan
Scan Details
Site Domain | ia.postcodebase.com |
Base Domain | postcodebase.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-06-06T02:20:05+00:00 |
Next Scan | 2025-09-04T02:20:05+00:00 |
Last Successful Scan
Scanned | 2024-07-19T00:44:54+00:00 |
URL | https://ia.postcodebase.com/robots.txt |
Domain IPs | 104.26.2.167, 104.26.3.167, 172.67.75.150, 2606:4700:20::681a:2a7, 2606:4700:20::681a:3a7, 2606:4700:20::ac43:4b96 |
Response IP | 172.67.75.150 |
Found | Yes |
Hash | 1c2d51afd7c66ef8fc4ebe914ccd4981059ba7ca35688965333cdb02d23ac3f2 |
SimHash | 13b63a42a453 |
Groups
baiduspider
Rule | Path |
---|---|
Disallow | /af/ |
Disallow | /sq/ |
Disallow | /hy/ |
Disallow | /az/ |
Disallow | /bg/ |
Disallow | /ca/ |
Disallow | /hr/ |
Disallow | /cs/ |
Disallow | /da/ |
Disallow | /nl/ |
Disallow | /eo/ |
Disallow | /et/ |
Disallow | /fi/ |
Disallow | /fil/ |
Disallow | /gl/ |
Disallow | /ka/ |
Disallow | /el/ |
Disallow | /hu/ |
Disallow | /is/ |
Disallow | /ga/ |
Disallow | /lv/ |
Disallow | /lt/ |
Disallow | /mk/ |
Disallow | /ms/ |
Disallow | /mt/ |
Disallow | /fa/ |
Disallow | /pl/ |
Disallow | /ro/ |
Disallow | /sr/ |
Disallow | /sk/ |
Disallow | /sl/ |
Disallow | /sw/ |
Disallow | /sv/ |
Disallow | /th/ |
Disallow | /tr/ |
Disallow | /uk/ |
Disallow | /vi/ |
Disallow | /cy/ |
yandexbot
Rule | Path |
---|---|
Disallow | /af/ |
Disallow | /sq/ |
Disallow | /hy/ |
Disallow | /az/ |
Disallow | /bg/ |
Disallow | /ca/ |
Disallow | /hr/ |
Disallow | /cs/ |
Disallow | /da/ |
Disallow | /nl/ |
Disallow | /eo/ |
Disallow | /et/ |
Disallow | /fi/ |
Disallow | /fil/ |
Disallow | /gl/ |
Disallow | /ka/ |
Disallow | /el/ |
Disallow | /hu/ |
Disallow | /is/ |
Disallow | /ga/ |
Disallow | /lv/ |
Disallow | /lt/ |
Disallow | /mk/ |
Disallow | /ms/ |
Disallow | /mt/ |
Disallow | /fa/ |
Disallow | /pl/ |
Disallow | /ro/ |
Disallow | /sr/ |
Disallow | /sk/ |
Disallow | /sl/ |
Disallow | /sw/ |
Disallow | /sv/ |
Disallow | /th/ |
Disallow | /tr/ |
Disallow | /vi/ |
Disallow | /cy/ |
Disallow | /ar/ |
Disallow | /de/ |
Disallow | /fr/ |
Disallow | /es/ |
Disallow | /it/ |
Disallow | /ja/ |
Disallow | /ko/ |
Disallow | /pt/ |
Disallow | /zh-hans/ |
Disallow | /zh-hant/ |
*
Rule | Path |
---|---|
Allow | /sites/default/files/ |
Disallow | /*feed |
Disallow | /*comment* |
Disallow | /*image_captcha* |
Disallow | /test/ |
Disallow | /*node?page= |
Disallow | /*feed |
Disallow | /cdn-cgi/ |
Disallow | /includes/ |
Disallow | /misc/ |
Disallow | /modules/ |
Disallow | /profiles/ |
Disallow | /scripts/ |
Disallow | /themes/ |
Disallow | /CHANGELOG.txt |
Disallow | /cron.php |
Disallow | /INSTALL.mysql.txt |
Disallow | /INSTALL.pgsql.txt |
Disallow | /INSTALL.sqlite.txt |
Disallow | /install.php |
Disallow | /INSTALL.txt |
Disallow | /LICENSE.txt |
Disallow | /MAINTAINERS.txt |
Disallow | /update.php |
Disallow | /UPGRADE.txt |
Disallow | /xmlrpc.php |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips/ |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/register/ |
Disallow | /user/password/ |
Disallow | /user/login/ |
Disallow | /user/logout/ |
Disallow | /?q=admin%2F |
Disallow | /?q=comment%2Freply%2F |
Disallow | /?q=filter%2Ftips%2F |
Disallow | /?q=node%2Fadd%2F |
Disallow | /?q=search%2F |
Disallow | /?q=user%2Fpassword%2F |
Disallow | /?q=user%2Fregister%2F |
Disallow | /?q=user%2Flogin%2F |
Disallow | /?q=user%2Flogout%2F |
Disallow | /*searchresult?keyword |
Disallow | /*search_any_address_results?key |
Disallow | /*new_drop_search |
Other Records
Field | Value |
---|---|
sitemap | https://ia.postcodebase.com/sitemap.xml |
sitemap | https://ia.postcodebase.com/sitemap_zipcode.xml |
sitemap | https://ia.postcodebase.com/sitemap_zipcode5.xml |
sitemap | https://ia.postcodebase.com/sitemap_city.xml |
sitemap | https://ia.postcodebase.com/sitemap_county.xml |
sitemap | https://ia.postcodebase.com/sitemap_random_address_city.xml |
sitemap | https://ia.postcodebase.com/sitemap_zipcode5_address.xml |
sitemap | https://ia.postcodebase.com/rss.xml |
Comments