wubbalubbadubdubb.ir
robots.txt
Robots Exclusion Standard data for wubbalubbadubdubb.ir
Resource Scan
Scan Details
Site Domain | wubbalubbadubdubb.ir |
Base Domain | wubbalubbadubdubb.ir |
Scan Status | Ok |
Last Scan | 2024-09-23T01:14:39+00:00 |
Next Scan | 2024-09-30T01:14:39+00:00 |
Last Scan
Scanned | 2024-09-23T01:14:39+00:00 |
URL | https://wubbalubbadubdubb.ir/robots.txt |
Domain IPs | 104.21.31.131, 172.67.176.138, 2606:4700:3033::ac43:b08a, 2606:4700:3037::6815:1f83 |
Response IP | 172.67.176.138 |
Found | Yes |
Hash | 67c3564758051c6042e25ec64a7f3f864926840dafc2d09ec58df81a35ff5aa2 |
SimHash | 67d4d6726ec0 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*/ajax/ |
Disallow | /*/blog/ |
Disallow | /*/comments/ |
Disallow | /*/add/ |
Disallow | /*/edit/ |
Disallow | /*/images/archive |
Disallow | /*/page/ |
Disallow | /*/stats/ |
Disallow | /*/videos/archive |
Disallow | /platforms/*/set/ |
Disallow | /addons/start/ |
Disallow | /admin |
Disallow | /articles/ajax/ |
Disallow | /cart |
Disallow | /comment |
Disallow | /company/ajax/ |
Disallow | /cutoff/html/ |
Disallow | /downloads/ajax/ |
Disallow | /downloads/mirror/ |
Disallow | /downloads/start/ |
Disallow | /downloads/timeout/ |
Disallow | /external |
Disallow | /features/ajax/ |
Disallow | /forum/ajax/ |
Disallow | /forum/shortcut/ |
Disallow | /forum/search |
Disallow | /games/ajax/ |
Disallow | /giveaways |
Disallow | /groups/ajax/ |
Disallow | /groups/gamefront/ |
Disallow | /groups/indiedb/ |
Disallow | /groups/moddb/ |
Disallow | /groups/slidedb/ |
Disallow | /groups/vrdb/ |
Disallow | /home |
Disallow | /hardware |
Disallow | /media |
Disallow | /members/ajax/ |
Disallow | /members/logout/ |
Disallow | /members/password/ |
Disallow | /members/permission/ |
Disallow | /messages |
Disallow | /mods/ajax/ |
Disallow | /newsletter/ajax/ |
Disallow | /profile |
Disallow | /reviews/ajax/ |
Disallow | /search |
Disallow | /software |
Disallow | /staff |
Disallow | /statistics |
Disallow | /tags/ajax/ |
Disallow | /tutorials/ajax/ |
mj12bot
ahrefsbot
semrushbot
dotbot
mauibot
petalbot
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*/ajax/ |
Disallow | /*/blog/ |
Disallow | /*/comments/ |
Disallow | /*/add/ |
Disallow | /*/edit/ |
Disallow | /*/images/archive |
Disallow | /*/page/ |
Disallow | /*/stats/ |
Disallow | /*/videos/archive |
Disallow | /platforms/*/set/ |
Disallow | /addons/start/ |
Disallow | /admin |
Disallow | /articles/ajax/ |
Disallow | /cart |
Disallow | /comment |
Disallow | /company/ajax/ |
Disallow | /cutoff/html/ |
Disallow | /downloads/ajax/ |
Disallow | /downloads/mirror/ |
Disallow | /downloads/start/ |
Disallow | /downloads/timeout/ |
Disallow | /external |
Disallow | /features/ajax/ |
Disallow | /forum/ajax/ |
Disallow | /forum/shortcut/ |
Disallow | /forum/search |
Disallow | /games/ajax/ |
Disallow | /giveaways |
Disallow | /groups/ajax/ |
Disallow | /groups/gamefront/ |
Disallow | /groups/indiedb/ |
Disallow | /groups/moddb/ |
Disallow | /groups/slidedb/ |
Disallow | /groups/vrdb/ |
Disallow | /home |
Disallow | /hardware |
Disallow | /media |
Disallow | /members |
Disallow | /messages |
Disallow | /mods/ajax/ |
Disallow | /newsletter/ajax/ |
Disallow | /profile |
Disallow | /reviews/ajax/ |
Disallow | /search |
Disallow | /software |
Disallow | /staff |
Disallow | /statistics |
Disallow | /tags/ajax/ |
Disallow | /tutorials/ajax/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.moddb.com/api/siteindex |
sitemap | https://www.moddb.com/api/siteindex |