appynation.com
robots.txt

Robots Exclusion Standard data for appynation.com

Resource Scan

Scan Details

Site Domain appynation.com
Base Domain appynation.com
Scan Status Ok
Last Scan2024-06-26T23:05:27+00:00
Next Scan 2024-07-03T23:05:27+00:00

Last Scan

Scanned2024-06-26T23:05:27+00:00
URL https://appynation.com/robots.txt
Redirect https://www.appynation.com/robots.txt
Redirect Domain www.appynation.com
Redirect Base appynation.com
Domain IPs 217.160.0.89
Redirect IPs 217.160.0.89
Response IP 217.160.0.89
Found Yes
Hash 0dcb7dca50d6392baeb2b60eb2229e83eb98cd61d50347871b986910c1a4c663
SimHash c8008b12cf91

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /intranet2

Other Records

Field Value
sitemap http://www.appynation.com/sitemap.xml.gz