semiengineering.com
robots.txt

Robots Exclusion Standard data for semiengineering.com

Resource Scan

Scan Details

Site Domain semiengineering.com
Base Domain semiengineering.com
Scan Status Ok
Last Scan2024-05-21T06:44:21+00:00
Next Scan 2024-06-20T06:44:21+00:00

Last Scan

Scanned2024-05-21T06:44:21+00:00
URL https://semiengineering.com/robots.txt
Domain IPs 104.26.10.161, 104.26.11.161, 172.67.73.36, 2606:4700:20::681a:aa1, 2606:4700:20::681a:ba1, 2606:4700:20::ac43:4924
Response IP 172.67.73.36
Found Yes
Hash 4b7f7d6c78ae51bba3c5988a353742b93c90a83190d3c0b0dee351de3c210da1
SimHash d945de40c553

Groups

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://semiengineering.com/sitemap_index.xml

Comments

  • WP Import Export Rule