automaton-media.com
robots.txt

Robots Exclusion Standard data for automaton-media.com

Resource Scan

Scan Details

Site Domain automaton-media.com
Base Domain automaton-media.com
Scan Status Ok
Last Scan2024-11-15T21:52:36+00:00
Next Scan 2024-11-22T21:52:36+00:00

Last Scan

Scanned2024-11-15T21:52:36+00:00
URL https://automaton-media.com/robots.txt
Domain IPs 104.26.8.82, 104.26.9.82, 172.67.75.13, 2606:4700:20::681a:852, 2606:4700:20::681a:952, 2606:4700:20::ac43:4b0d
Response IP 104.26.9.82
Found Yes
Hash 11295c9eee06b8536b3f09a3adb3fa30c50d37fa02df5218354812b6f0f1d424
SimHash 55545d4fe4b3

Groups

googlebot-news

Rule Path
Disallow /articles/now-gaming/
Disallow /articles/announcementsjp/
Disallow /articles/wallet-messiah/
Disallow /articles/not-gaming/
Disallow /articles/columnjp/mother-2-at-30
Disallow /articles/impressionjp/review-dead-or-alive-5-last-round/
Disallow /articles/interviewsjp/access-games-swery-interview-how-did-d4-and-pc-version-made/
Disallow /articles/interviewsjp/interview-swery-access-games-a-very-swery-life/
Disallow /about/
Disallow /contact/
Disallow /privacy-policy/
Disallow /terms-of-use/
Disallow /sitemap/
Disallow /articles/newsjp/love-wins-in-game-industry/
Disallow /articles/newsjp/leaked-fallout-4-footage-uploaded-to-pornhub/
Disallow /articles/impressionjp/20161129-34948/

*

Rule Path
Disallow /author/nobuki-yasuda/
Disallow /author/yusuke-saito/
Disallow /team/
Disallow /team_cats/
Disallow /*/*/*/attachment/
Disallow /events/
Disallow /articles/newsjp/most-popular/
Disallow /games/
Disallow /articles/columnjp/2013-videogame-recap/
Disallow /?s%2B
Disallow /?s*%28
Disallow /?s*%29
Disallow /?s*-
Disallow /?s*%5B
Disallow /?s*%5D
Disallow /?s=*%40
Disallow /?s=*%28
Disallow /?s=*%29
Disallow /?s=*%7B
Disallow /?s=*%7D
Disallow /?s=*%5B
Disallow /?s=*%5D
Disallow /?s=*-
Disallow /?s=*%2B
Disallow *SuperSocializerAuth%3DLiveJournal
Disallow /?s=*%C3%A5%C2%BE%C2%AE%C3%A4%C2%BF%C2%A1

Comments

  • Disallow: /tag/

Warnings

  • 3 invalid lines.