atlanta.net
robots.txt
Robots Exclusion Standard data for atlanta.net
Resource Scan
Scan Details
Site Domain | atlanta.net |
Base Domain | atlanta.net |
Scan Status | Ok |
Last Scan | 2024-09-26T01:48:54+00:00 |
Next Scan | 2024-10-26T01:48:54+00:00 |
Last Scan
Scanned | 2024-09-26T01:48:54+00:00 |
URL | https://atlanta.net/robots.txt |
Redirect | https://discoveratlanta.com/robots.txt |
Redirect Domain | discoveratlanta.com |
Redirect Base | discoveratlanta.com |
Domain IPs | 34.73.189.215, 34.74.8.155, 34.75.104.115 |
Redirect IPs | 34.73.189.215, 34.74.8.155, 34.75.104.115 |
Response IP | 34.75.104.115 |
Found | Yes |
Hash | bf04040d6a72bad2c2a209a29b5b7d7ce6c26a2eb06f56812d0c76c3849fe3d2 |
SimHash | f01151058296 |
Groups
amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
facebookbot
facebookexternalhit
friendlycrawler
gptbot
icc-crawler
imagesiftbot
img2dataset
meta-externalagent
oai-searchbot
omgili
omgilibot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
youbot
meta-externalfetcher
applebot
Rule | Path |
---|---|
Disallow | / |