tools-giant.com
robots.txt

Robots Exclusion Standard data for tools-giant.com

Resource Scan

Scan Details

Site Domain tools-giant.com
Base Domain tools-giant.com
Scan Status Ok
Last Scan2025-11-25T00:46:13+00:00
Next Scan 2025-12-25T00:46:13+00:00

Last Scan

Scanned2025-11-25T00:46:13+00:00
URL https://tools-giant.com/robots.txt
Redirect https://www.tools-giant.com/robots.txt
Redirect Domain www.tools-giant.com
Redirect Base tools-giant.com
Domain IPs 116.202.53.185
Redirect IPs 116.202.53.185
Response IP 116.202.53.185
Found Yes
Hash 054bf0c18a3039c17e90f10f15d1a90b9892cba9b10e99fe786577a32826e4b8
SimHash 985cdd54cbf0

Groups

googlebot

Rule Path
Disallow

blexbot
icc-crawler
fr-crawler
ccbot
orangebot
memorybot
itsbetter-bot
insitesbot
dotbot
ahrefsbot
seokicks-robot
semrushbot
ltx71
mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /Admin/

Warnings

  • 3 invalid lines.
  • `header("content-type` is not a known field.