VBGamer

Content

Post

Resources

Other

Console

Username:	Password:
Save Password
Forgot your Password?

All Forums

VBGamer

We hate spammers

Note: You must be registered in order to post a reply.

Screensize:

UserName:

Password:

Format Mode:

Format:

Message:

* HTML is OFF
* Forum Code is ON

Smilies

Insert an File
Check here to include your profile signature.
Check here to subscribe to this topic.

T O P I C R E V I E W
lionel	Posted - Dec 20 2004 : 09:25:25 AM Need help with software development? consulting and outsourcing marketplace, where you can post your project free and receive bids from a global pool of knowledge workers and service providers. I'm a spammer and I'm stupid.
10 L A T E S T R E P L I E S (Newest First)
Almar	Posted - Dec 23 2004 : 02:45:18 AM Yeah, I read somewhere the MSNBot is quite aggressive :)
VBBR	Posted - Dec 22 2004 : 4:36:09 PM I think we're getting more MSN bot hits because the MSN search system is being re-created or something (they say to better it), so I think it needs to crawl everything again. Anyway, Google rocks.
Eric Coleman	Posted - Dec 22 2004 : 11:15:34 AM Here are some interesting graphs. The numbers at the bottom are Month / Day /Year. The graphs show daily activity for 2004. This shows browser referrals. Most people come from google. Practically 0 people are coming from either the Yahoo or MSN website. VBgamer aparently doesn't rank very high with them. Download Attachment: Daily_Search_Engines.png 9.42 KB This shows the spider or bot's daily activity. Around Aug 1 is when bot activity dramatically increased. Google has the highest hit count for a single day. Download Attachment: Top_Spiders.png 5.76 KB However, if you look at this graph, you can see that overall the MSN robot is more active than either Google or Yahoo(Inktomi Slurp is Yahoo). Download Attachment: Daily_Spider_Activity.png 7.77 KB What's interesting about all this is comparing bot activity versus the number of hits from those search engines. Google brings in the most hits, so it's robot activity is somewhat usefull. MSN downloads lots of stuff but no one ever finds vbgamer by searching with MSN. By comparing pages downloaded to search engine referrals we get the following ratios: Google: 1.4 pages downloaded for every referal MSN: 98.7 pages downloaded for every referal Yahoo: 16.9 pages downloaded for every referal MSN just sucks!
Almar	Posted - Dec 22 2004 : 06:53:42 AM The MSN bot is horrible. It downloaded about 80 times YALG before I noticed the download logs (yes, I keep track of all downloads on my site, just for stuff like this). It's like 800mb. Not that Icare that much (800mb isn't really much), but it would simply have continued for weeks and months. If you search on some of the IP's eric, you can find some info on most bots, and possibly a) ban them or b) use robots.txt (which is ignored anyway by most search engines, imo) I'm simply returning an error from the download counter script, if the IP matches the MSN bot one.
Krisc	Posted - Dec 21 2004 : 5:35:52 PM I think it might even be enough to just create a "Click yes to verify you are not a bot..."
VBBR	Posted - Dec 21 2004 : 11:31:31 AM You could display a simple picture of a circle, square or triangle (randomly), then ask the user "What is that?" -> "A circle" / "A Square" / "A Triangle" / "None of the above". Maybe the 5th option could be "I'm a bot".
Eric Coleman	Posted - Dec 21 2004 : 09:59:59 AM I'm not sure what kind of software I would have to install on the server to do stuff like that. Instead I was thinking more along the lines of a simple test. A few questions with multiple answers. Bots aren't smart enough to understand language yet but the questions would be obvious. What is two plus 2? A couple of answers could be 2, two, 4, etc. Or maybe something like E=mc^2? The answers could be Albert Einstein, George Bush, Your mother. I removed the link from the post above. I think we can continue this post on how best to defeat spam bots. Lately VBgamer is being crawled very heavily by search engines. MSN, Inktomi, and Google are really big sources of bot traffic, but there are lots of other bots though. I suspect they're mostly email harvesters.
VBBR	Posted - Dec 21 2004 : 05:02:25 AM Shouldn't the topic be deleted? We're advertising it yet more by replying. And what about the "numbers-and-letters-mixed-with-lines-so-a-bot-can't-register" approach?
Eric Coleman	Posted - Dec 20 2004 : 3:46:17 PM this is probably just a bot of some sort. I guess it's stime to start locking down different areas of the website.
VBBR	Posted - Dec 20 2004 : 10:12:32 AM ...wait. I think that if VBGamer wanted advertising in the website, it could use Google or something like that. Or am I wrong? Did the staff authorize that?

VBGamer

This page was generated in 0.08 seconds.

Snitz Forums 2000