artfacts.net
robots.txt
Robots Exclusion Standard data for artfacts.net
Resource Scan
Scan Details
| Site Domain | artfacts.net |
| Base Domain | artfacts.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-07T12:08:42+00:00 |
| Next Scan | 2024-07-06T12:08:42+00:00 |
Last Successful Scan
| Scanned | 2023-02-20T08:04:35+00:00 |
| URL | https://artfacts.net/robots.txt |
| Domain IPs | 104.22.24.190, 104.22.25.190, 172.67.26.189, 2606:4700:10::6816:18be, 2606:4700:10::6816:19be, 2606:4700:10::ac43:1abd |
| Response IP | 104.22.24.190 |
| Found | Yes |
| Hash | 6bbb3debaa67d020f3178e276807ee4c06b5c281a5def886fb8cccbd7c6c0a5c |
| SimHash | 01311a82cf2c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /login |
| Disallow | /register |
| Disallow | /feedback |
| Disallow | /upgrade |
bingbot
bingbot/2.0
yahoo-slurp
yahoo-mmcrawler
psbot
teoma
exabot
gigabot
ia_archiver
baiduspider
nutch
webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
a-online search
atn_worldwide
arachnophilia
architextspider
fast
scooter
crawler v 0.2.1 admin@crawler.de
coolbot
deweb/1.01
grabber
eule-robot
arachnoidea
architextspider
kit-fireball/2.0
ibm_planetwide
infoseek sidewinder/0.9
slurp
linkwalker
webmoose
tarantula
gulliver/1.3
fido/1.0 harvest/1.4.pl2
megasheep
ultraseek
whatuseek_winona
ccbot
semrushbot
sogou
| Rule | Path |
|---|---|
| Disallow | / |
Comments