Blogs Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
 


Go Back   Oddworld Forums > Blogs > moxco


Rate this Entry

robots.txt

Posted 06-25-2013 at 10:33 PM by moxco
I noticed OWF wasn't coming up in google, so I checked it's robots.txt and saw this:

Quote:
User-Agent: *
Disallow: /
Crawl-Delay: 10
I've been absent for a while so I might have missed something, but is there a reason for why the mods don't want search engines crawling this site? Has it got to do with bestiality?
Total Comments 19

Comments

Old
Phylum's Avatar
So this means that we can say the z-word again?
Posted 06-25-2013 at 10:36 PM by Phylum Phylum is offline

Old
Nate's Avatar
I'm guessing that it changed with the vBulletin update and Alcar didn't realise.
Posted 06-26-2013 at 12:32 AM by Nate Nate is offline

Old
Nate's Avatar
Although if it's been going on longer, this might explain why we haven't had any new member registrations in weeks.
Posted 06-26-2013 at 12:35 AM by Nate Nate is offline

Old
Nate's Avatar
Alcar has been told. He says it was part of the update. He has not yet given an ETA on fixing it.
Posted 06-26-2013 at 12:40 AM by Nate Nate is offline

Old
STM's Avatar
And thus OWF, which is already pretty backwater as is, completely fell off the radar and became the most incestuous place on the net.
Posted 06-26-2013 at 02:27 AM by STM STM is offline

Old
Jordan's Avatar
we can get up to all kinds of things without people watching us!
Posted 06-26-2013 at 02:33 AM by Jordan Jordan is offline

Old
STM's Avatar
I'm walking around naked.
Posted 06-26-2013 at 02:36 AM by STM STM is offline

Old
Vyrien's Avatar
We're in the deep web now.
Posted 06-26-2013 at 04:37 AM by Vyrien Vyrien is offline

Old
Varrok's Avatar
You were doing those things even before, so It doesn't count.
Posted 06-26-2013 at 05:47 AM by Varrok Varrok is offline

Old
Jordan's Avatar
Don't crush everyone's dreams
Posted 06-26-2013 at 05:48 AM by Jordan Jordan is offline

Old
MeechMunchie's Avatar
Well, I guess it's time for the forum anthem.

♪ Zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia zoophilia ♫
Posted 06-26-2013 at 07:57 AM by MeechMunchie MeechMunchie is offline

Old
Wil's Avatar
If this is a result of the recent update, why have we been absent from Google for weeks? Explanation rejected.

Unless they can now somehow operate retrospectively, the robots.txt must have been around longer. Hang on, I'll find a cached version on Google to check.
Posted 06-26-2013 at 11:11 AM by Wil Wil is offline

Old
Phylum's Avatar
Is the lack of new members what nate_test was about?
Posted 06-26-2013 at 04:36 PM by Phylum Phylum is offline

Old
Nate's Avatar
Quote:
Originally Posted by Wil
If this is a result of the recent update, why have we been absent from Google for weeks? Explanation rejected.
Have we been absent from Google for weeks? Or was that just a guess based on the lack of new members?

Quote:
Originally Posted by Phylum
Is the lack of new members what nate_test was about?
Yes. And nate_test2 and nate_test3.
Posted 06-26-2013 at 07:34 PM by Nate Nate is offline

Old
Manco's Avatar
Iím very disappointed that thereís no humans.txt
Posted 06-27-2013 at 03:14 AM by Manco Manco is offline

Old
moxco's Avatar
Quote:
Have we been absent from Google for weeks? Or was that just a guess based on the lack of new members?
Yes, for at least a month, I think.
Posted 06-27-2013 at 03:22 AM by moxco moxco is offline

Old
Nate's Avatar
Based on what?
Posted 06-27-2013 at 05:08 AM by Nate Nate is offline

Old
moxco's Avatar
The fact that I noticed some weeks ago that this website wasn't on the first page of results when "Oddworld Forums" was googled. At the time I legitimately wondered if it was some anti-SEO techniques you guys were employing to combat zoophilia results.
Posted 06-27-2013 at 05:12 AM by moxco moxco is offline

Old
Nate's Avatar
Thanks for the information.

If you ever see anything like this again, please let us know straight away.
Posted 06-27-2013 at 06:00 AM by Nate Nate is offline

 

Recent Blog Entries by moxco



All times are GMT -8. The time now is 05:31 PM.

Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2019, vBulletin Solutions, Inc.

Please note that the Oddworld Forums are not affiliated with Oddworld Inhabitants.