duplichecker.com
robots.txt

Robots Exclusion Standard data for duplichecker.com

Resource Scan

Scan Details

Site Domain duplichecker.com
Base Domain duplichecker.com
Scan Status Ok
Last Scan2024-05-13T03:11:42+00:00
Next Scan 2024-05-20T03:11:42+00:00

Last Scan

Scanned2024-05-13T03:11:42+00:00
URL https://duplichecker.com/robots.txt
Redirect https://www.duplichecker.com/robots.txt
Redirect Domain www.duplichecker.com
Redirect Base duplichecker.com
Domain IPs 104.26.12.84, 104.26.13.84, 172.67.69.27, 2606:4700:20::681a:c54, 2606:4700:20::681a:d54, 2606:4700:20::ac43:451b
Redirect IPs 104.26.12.84, 104.26.13.84, 172.67.69.27, 2606:4700:20::681a:c54, 2606:4700:20::681a:d54, 2606:4700:20::ac43:451b
Response IP 104.26.12.84
Found Yes
Hash d2247e1a08d6e9c5441070c3e6c0afb0b2cde0226bc717e8c9d707520a9f9f8e
SimHash 404c58f007a3

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow /*?desc=*&name=*
Disallow /share-page/*
Disallow /view-share-page/*
Disallow /show-compare-results
Disallow /sync/*

Other Records

Field Value
sitemap https://www.duplichecker.com/sitemap.xml