welcometocountry.org
robots.txt

Robots Exclusion Standard data for welcometocountry.org

Resource Scan

Scan Details

Site Domain welcometocountry.org
Base Domain welcometocountry.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-16T17:08:30+00:00
Next Scan 2024-12-15T17:08:30+00:00

Last Successful Scan

Scanned2023-11-22T16:52:52+00:00
URL https://welcometocountry.org/robots.txt
Redirect https://www.welcometocountry.org/robots.txt
Redirect Domain www.welcometocountry.org
Redirect Base welcometocountry.org
Domain IPs 114.142.160.14
Redirect IPs 114.142.160.14
Response IP 114.142.160.14
Found Yes
Hash 5adb6a92413c58ed329ebe5114f176d346a806ae5f0bab48cca82af5b10ea0c6
SimHash e9008a02cf92

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.welcometocountry.org/sitemap.xml
sitemap https://www.welcometocountry.org/sitemap.rss