publishersmarketplace.com
robots.txt
Robots Exclusion Standard data for publishersmarketplace.com
Resource Scan
Scan Details
| Site Domain | publishersmarketplace.com |
| Base Domain | publishersmarketplace.com |
| Scan Status | Ok |
| Last Scan | 2025-03-07T12:06:18+00:00 |
| Next Scan | 2025-04-06T12:06:18+00:00 |
Last Scan
| Scanned | 2025-03-07T12:06:18+00:00 |
| URL | https://www.publishersmarketplace.com/robots.txt |
| Domain IPs | 52.116.141.222 |
| Response IP | 52.116.141.222 |
| Found | Yes |
| Hash | d5787b6371d9db3a3d5a8410b00fdbe5229b5ba9f0b93feab04b05c0ced3bd58 |
| SimHash | f819095dac35 |
Groups
amazonbot
anthropic-ai
applebot
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
google-extended
gptbot
imagesiftbot
mj12bot
mp3bot
omgili
omgilibot
omgilibot
perplexitybot
piplbot
youbot
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /ads/ |
| Disallow | /admin/ |
| Disallow | /amazon/ |
| Disallow | /assist/ |
| Disallow | /automat/feed.cgi |
| Disallow | /blog/ |
| Disallow | /bookmarks/ |
| Disallow | /cgi/ |
| Disallow | /cgi-bin/processSendBlogComment.pl |
| Disallow | /cgi-bin/sendBlogComment.pl |
| Disallow | /counter/ |
| Disallow | /contacts/ |
| Disallow | /dealmakers/perf* |
| Disallow | /home/ |
| Disallow | /includes/ |
| Disallow | /js/ |
| Disallow | /login.php |
| Disallow | /lunch/subscribe.cgi |
| Disallow | /missing.php |
| Disallow | /pdfviewer/ |
| Disallow | /test/ |
| Disallow | /xml/ |
*
| Rule | Path |
|---|---|
| Disallow | /ads/ |
| Disallow | /admin/ |
| Disallow | /amazon/ |
| Disallow | /assist/ |
| Disallow | /automat/ |
| Disallow | /blog/ |
| Disallow | /bookmarks/ |
| Disallow | /cgi/ |
| Disallow | /cgi-bin/ |
| Disallow | /cgi-bin/processSendBlogComment.pl |
| Disallow | /cgi-bin/sendBlogComment.pl |
| Disallow | /counter/ |
| Disallow | /contacts/ |
| Disallow | /home/ |
| Disallow | /includes/ |
| Disallow | /js/ |
| Disallow | /login.php |
| Disallow | /lunch/subscribe.cgi |
| Disallow | /missing.php |
| Disallow | /NYT/ |
| Disallow | /pdfviewer/ |
| Disallow | /PW/ |
| Disallow | /test/ |
| Disallow | /xml/ |
Comments