soccerway.futbol
robots.txt

Robots Exclusion Standard data for soccerway.futbol

Resource Scan

Scan Details

Site Domain soccerway.futbol
Base Domain soccerway.futbol
Scan Status Ok
Last Scan2024-09-25T18:52:23+00:00
Next Scan 2024-10-02T18:52:23+00:00

Last Scan

Scanned2024-09-25T18:52:23+00:00
URL https://soccerway.futbol/robots.txt
Redirect https://www.soccerway.com/robots.txt
Redirect Domain www.soccerway.com
Redirect Base soccerway.com
Domain IPs 52.17.183.181, 52.209.63.149, 54.171.252.128
Redirect IPs 184.29.88.145
Response IP 104.69.156.83
Found Yes
Hash 782e22e12402ae973bc3c4669e06cec6005df7889ff9f2a757aa5de0fe0e6464
SimHash f098d9c1a380

Groups

semrushbot-sa
piplbot
dataforseobot
macocu
serpstatbot

Rule Path
Disallow /

gptbot
claudebot
claude-web
ccbot
applebot-extended
facebookbot
meta-externalagent
diffbot
perplexitybot
omgili
omgilibot
imagesiftbot
bytespider
amazonbot
youbot

Rule Path
Disallow /

*

Rule Path
Disallow /search/
Disallow