Log In Sign Up

gpsoft.in
robots.txt

Robots Exclusion Standard data for gpsoft.in

Resource Scan

Scan Details

Site Domain gpsoft.in
Base Domain gpsoft.in
Scan Status Ok
Last Scan2024-11-12T08:55:34+00:00
Next Scan 2024-11-19T08:55:34+00:00

Last Scan

Scanned2024-11-12T08:55:34+00:00
URL https://gpsoft.in/robots.txt
Domain IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153
Response IP 185.199.110.153
Found Yes
Hash 71d9b859e7ffeb6413481a8ce766bbd668816e9246b674b00519a74e27c28a4e
SimHash ed0c9153caf1

Groups

siteauditbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Allow /**

*

Rule Path
Allow /*
Disallow /*/?*

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://www.gpsoft.in/sitemap.xml
Back to top

Comments

  • Sitemap files
Back to top

Warnings

  • 2 invalid lines.
Back to top