gdz.expert
robots.txt

Robots Exclusion Standard data for gdz.expert

Resource Scan

Scan Details

Site Domain gdz.expert
Base Domain gdz.expert
Scan Status Ok
Last Scan2024-11-09T17:03:04+00:00
Next Scan 2024-11-16T17:03:04+00:00

Last Scan

Scanned2024-11-09T17:03:04+00:00
URL https://gdz.expert/robots.txt
Redirect https://megashpora.com/robots.txt
Redirect Domain megashpora.com
Redirect Base megashpora.com
Domain IPs 104.21.35.111, 172.67.218.229, 2606:4700:3035::6815:236f, 2606:4700:3036::ac43:dae5
Redirect IPs 104.21.80.196, 172.67.187.26, 2606:4700:3033::6815:50c4, 2606:4700:3037::ac43:bb1a
Response IP 104.21.80.196
Found Yes
Hash 801ee668acf0e9b54825d356a559f4f9e8aa35559939473d430c2473a55b859f
SimHash 48409863c312

Groups

*

Rule Path
Allow /
Disallow /search/*

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://megashpora.com/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.