CodeDotNet

When building this site, one of the first elements I allocated time for was a logging feature, both to collect error information for debugging, as well as user information. Below is a view of the log data stored, but called from a web service, using a mixture of VB.NET to return the data and transform the XML, and ASP.NET to display it.



LogIDTypeTypeMessageTimeStampBrowserInfoPagePathIPAddressDNSName
91277PageHitService Request2018-12-10T19:21:07.877-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91276PageHit 2018-12-10T19:21:07.587-08:00CCBot/2.0 (https://commoncrawl.org/faq/)LogViewer_ws.aspx52.91.245.237web703
91275PageHit 2018-12-10T19:13:41.5-08:00Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)default.aspx123.126.113.122web703
91274ErrorError 4042018-12-10T19:12:43.047-08:00Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)Error404.aspx123.126.113.122web703
91273PageHit 2018-12-10T19:07:21.403-08:00CCBot/2.0 (https://commoncrawl.org/faq/)default.aspx52.91.245.237web703
91272PageHit 2018-12-10T19:06:41.893-08:00CCBot/2.0 (https://commoncrawl.org/faq/)LogViewer_Silverlight.aspx52.91.245.237web703
91271PageHit 2018-12-10T19:06:35.54-08:00CCBot/2.0 (https://commoncrawl.org/faq/)BlackScholes_European_Silverlight.aspx52.91.245.237web703
91270ErrorError 4042018-12-10T18:45:41.49-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Error404.aspx207.46.13.131web703
91269PageHit 2018-12-10T18:45:31.66-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)default.aspx40.77.167.92web703
91268ErrorError 4042018-12-10T18:45:27.147-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Error404.aspx157.55.39.34web703
91267PageHit 2018-12-10T18:36:03.333-08:00CCBot/2.0 (https://commoncrawl.org/faq/)BlackScholes_European_Lookup.aspx52.91.245.237web703
91266PageHit 2018-12-10T18:20:02.697-08:00CCBot/2.0 (https://commoncrawl.org/faq/)USPS_ZipCodeLookup.aspx52.91.245.237web703
91265ErrorError 4042018-12-10T18:20:02.397-08:00CCBot/2.0 (https://commoncrawl.org/faq/)Error404.aspx52.91.245.237web703
91264PageHit 2018-12-10T16:48:57.653-08:00Mozilla/5.0 (compatible; AlphaBot/3.2; +http://alphaseobot.com/bot.html)default.aspx23.237.4.26web703
91263PageHit 2018-12-10T16:48:56.86-08:00Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36default.aspx194.44.247.218web703
91262PageHit 2018-12-10T14:49:16.49-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)default.aspx100.43.85.121web703
91261PageHit 2018-12-10T14:49:15.87-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)default.aspx37.9.87.221web703
91260ErrorError 4042018-12-10T14:49:12.553-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Error404.aspx5.255.250.135web703
91259ErrorError 4042018-12-10T14:49:12.377-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Error404.aspx100.43.90.126web703
91258PageHitService Request2018-12-10T14:05:19.563-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91257PageHit 2018-12-10T14:05:19.35-08:00Mozilla/5.0 (X11; Linux i686 (x86_64)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3394.0 Safari/537.36LogViewer_ws.aspx142.252.249.225web703
91256PageHit 2018-12-10T14:01:07.3-08:00Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)default.aspx95.163.255.58web703
91255ErrorError 4042018-12-10T14:01:05.423-08:00Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)Error404.aspx95.163.255.53web703
91254ErrorError 4042018-12-10T11:43:55.073-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Error404.aspx157.55.39.36web703
91253PageHit 2018-12-10T11:35:57.707-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)default.aspx40.77.167.134web703
91252ErrorError 4042018-12-10T11:08:32.37-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Error404.aspx157.55.39.36web703
91251ErrorError 4042018-12-10T11:02:40.13-08:00Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Error404.aspx157.55.39.36web703
91250PageHit 2018-12-10T11:02:20.693-08:00Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)default.aspx66.249.65.213web703
91249ErrorError 4042018-12-10T11:02:16.82-08:00Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)Error404.aspx66.249.65.217web703
91248PageHitService Request2018-12-10T10:53:38.48-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91247PageHit 2018-12-10T10:53:38.07-08:00Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36LogViewer_ws.aspx91.108.177.23web703
91246ErrorError 4042018-12-10T10:09:02.927-08:00Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.93 Safari/537.36Error404.aspx123.125.67.156web703
91245PageHit 2018-12-10T09:29:59.21-08:00Mozilla/5.0 (X11; CrOS armv7l 11021.81.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Safari/537.36default.aspx12.198.24.90web703
91244PageHit 2018-12-10T08:43:01.163-08:00Mozilla/5.0 (compatible; Nimbostratus-Bot/v1.3.2; http://cloudsystemnetworks.com)default.aspx209.17.96.234web703
91243ErrorError 4042018-12-10T08:41:00.52-08:00Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)Error404.aspx107.21.1.8web703
91242ErrorError 4042018-12-10T08:41:00.24-08:00Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)Error404.aspx54.208.102.37web703
91241PageHit 2018-12-10T08:41:00.177-08:00Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)default.aspx107.21.1.8web703
91240PageHit 2018-12-10T08:40:58.567-08:00Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)default.aspx54.208.102.37web703
91239PageHit 2018-12-10T08:18:10.287-08:00SEMrushBotdefault.aspx192.243.53.51web703
91238ErrorError 4042018-12-10T08:14:21.643-08:00Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)Error404.aspx95.163.255.53web703
91237PageHit 2018-12-10T07:58:50.037-08:00Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36default.aspx52.53.201.78web703
91236PageHit 2018-12-10T07:08:43.21-08:00Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Safari/602.1default.aspx3.17.55.104web703
91235PageHit 2018-12-10T07:07:02.87-08:00Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36; 360Spiderdefault.aspx42.236.99.154web703
91234PageHit 2018-12-10T06:35:18-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)default.aspx5.255.250.118web703
91233PageHit 2018-12-10T06:35:17.68-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)default.aspx77.88.5.46web703
91232ErrorError 4042018-12-10T06:35:14.11-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Error404.aspx77.88.5.46web703
91231ErrorError 4042018-12-10T06:35:13.833-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Error404.aspx77.88.5.46web703
91230PageHitService Request2018-12-10T06:26:40.76-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91229PageHit 2018-12-10T06:26:40.517-08:00Mozilla/5.0 (Windows NT 6.2; Win64; x64; rv:52.0) Gecko/20100101 Firefox/52.0LogViewer_ws.aspx80.85.159.169web703
91228PageHit 2018-12-10T06:09:06.02-08:00Mozilla/5.0 (X11; Linux x86_64) Gecko/20100101 Firefox/42.0default.aspx3.17.26.249web703
91227PageHit 2018-12-10T05:08:43.087-08:00Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Safari/602.1default.aspx3.16.186.19web703
91226PageHit 2018-12-10T04:08:34.767-08:00Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Chrome/67.0.3396.79 Safari/537.36default.aspx18.224.140.245web703
91225PageHit 2018-12-10T03:08:34.217-08:00Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Chrome/51.0.2704.106 Safari/537.36 OPR/38.0.2220.41default.aspx18.188.46.98web703
91224PageHit 2018-12-10T02:31:59.93-08:00Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36(KHTML, like Gecko) Chrome/61.0.3116.0 Safari/537.36 Chrome-LighthouseBlackScholes_European_Silverlight.aspx212.72.159.22web703
91223PageHitService Request2018-12-10T02:31:58.993-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91222PageHit 2018-12-10T02:31:58.973-08:00Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36(KHTML, like Gecko) Chrome/61.0.3116.0 Safari/537.36 Chrome-LighthouseLogViewer_ws.aspx212.72.159.22web703
91221PageHitService Request2018-12-10T02:18:58.64-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91220PageHit 2018-12-10T02:18:58.623-08:00Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.93 Safari/537.36LogViewer_ws.aspx202.46.49.202web703
91219PageHitService Request2018-12-10T02:16:41.797-08:00Mozilla/4.0 (compatible; MSIE 6.0; MS Web Services Client Protocol 4.0.30319.36470)LogViewer_ws.asmx209.67.188.9web703
91218PageHit 2018-12-10T02:16:41.32-08:00Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Safari/537.36 VivoBrowser/5.4.0 Chrome/38.0.2125.102,gzip(gfe)LogViewer_ws.aspx188.212.15.4web703
91217PageHit 2018-12-10T02:08:53.27-08:00Mozilla/5.0 (X11; Linux x86_64) Gecko/20100101 Chrome/67.0.3396.79 Safari/537.36default.aspx18.222.172.93web703
91216PageHit 2018-12-10T01:09:42.47-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)default.aspx5.255.250.118web703
91215PageHit 2018-12-10T01:09:42.18-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)default.aspx77.88.5.46web703
91214ErrorError 4042018-12-10T01:09:38.62-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Error404.aspx5.255.250.118web703
91213ErrorError 4042018-12-10T01:09:38.333-08:00Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)Error404.aspx77.88.5.46web703
91212PageHit 2018-12-10T01:08:40.247-08:00Mozilla/5.0 (Macintosh; Intel Mac OS X x.y; rv:42.0) Gecko/20100101 Firefox/42.0default.aspx18.224.136.152web703
91211PageHit 2018-12-10T00:08:56.68-08:00Mozilla/5.0 (X11; Linux x86_64) Gecko/20100101 Firefox/42.0default.aspx3.16.143.41web703
91210ArchiveLog archived2018-12-10T00:08:56.673-08:00NANANANA