Main menu:

Site search

Categories

Archive

Archive for August, 2008

How to find what robots have visited my website

Ever wonder how to find out what robots/crawlers have visited your site? If you don’t have robust log analyzer there is another way. If you are using apache there is a simple way from the command line to figure out how as been visiting.
grep robots.txt /etc/httpd/domlogs/bumideas.com|awk -F ‘”‘ ‘{print $6}’|sort -k 1|uniq -c
What […]

List of places to ping a blog

Here is a ping list I found on www.prelovac.com that I am trying out.
http://1470.net/api/ping
http://api.my.yahoo.com/rss/ping
http://api.feedster.com/ping
http://api.moreover.com/ping
http://api.moreover.com/RPC2
http://bblog.com/ping.php
http://blogsearch.google.com/ping/RPC2
http://blog.goo.ne.jp/XMLRPC
http://blogmatcher.com/u.php
http://blogdb.jp/xmlrpc/
http://bulkfeeds.net/rpc
http://coreblog.org/ping/
http://ping.cocolog-nifty.com/xmlrpc
http://ping.blo.gs/
http://ping.weblogalot.com/rpc.php
http://ping.bitacoras.com
http://ping.feedburner.com
http://ping.fakapster.com/rpc
http://ping.weblogs.se/
http://ping.syndic8.com/xmlrpc.php
http://ping.myblog.jp
http://ping.blogmura.jp/rpc/
http://pingoat.com/goat/RPC2
http://ping.bloggers.jp/rpc/
http://pinger.blogflux.com/rpc
http://rpc.icerocket.com:10080/
http://rpc.blogrolling.com/pinger/
http://rpc.tailrank.com/feedburner/RPC2
http://rpc.pingomatic.com/
http://rpc.weblogs.com/RPC2
http://rpc.britblog.com
http://rpc.technorati.com/rpc/ping
http://rpc.wpkeys.com
http://topicexchange.com/RPC2
http://trackback.bakeinu.jp/bakeping.php
http://www.blogdigger.com/RPC2
http://www.blogpeople.net/servlet/weblogUpdates
http://www.bitacoles.net/ping.php
http://www.blogoon.net/ping/
http://xmlrpc.blogg.de
http://xping.pubsub.com/ping
we will need to see how this list performs….

How to bulk replace strings in a file on linux

Ever find that you need to do a bulk/mass replacement of strings in a file on a linux server?  I ran into a situation where I needed to change a website from using persistent connections to mysql to normal.  This involved changing mysql_pconnect to mysql_connect.  Using grep, There were about 5 files to change.
Of course […]

How to ping a sitemap

You may have heard of pinging a blog, but did you know that you can ping a sitemap? Ping it to let the services know that you have some new web pages.
Ask.com:
http://submissions.ask.com/ping?sitemap=http://www.yourdomain.com/sitemap.xml

Google:
http://www.google.com/webmasters/sitemaps/ping?sitemap=http://www.yourdomain.com/sitemap.xml

Yahoo:
http://search.yahooapis.com/SiteExplorerService/V1/updateNotification?appid=YahooDemo&url=http://www.yourdomain.com/sitemap.xml
Hopefully I can find a couple more.

blacklist for phpbb forums to help stop spam

Looking for a good way to help prevent forum spam on your phpbb forum?  There is a phpbb hack that will check against the major spam lists such as spamcop and spamhaus.
 
http://www.phpbbhacks.com/download/4878
 
I just installed this one today on a site of mine, we shall see if it works.