<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
	>

<channel>
	<title>My Blog</title>
	<atom:link href="http://largedata.wordpress.com/feed/" rel="self" type="application/rss+xml" />
	<link>http://largedata.wordpress.com</link>
	<description>Just another WordPress.com weblog</description>
	<lastBuildDate>Mon, 22 Dec 2008 19:07:02 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
<cloud domain='largedata.wordpress.com' port='80' path='/?rsscloud=notify' registerProcedure='' protocol='http-post' />
<image>
		<url>http://s2.wp.com/i/buttonw-com.png</url>
		<title>My Blog</title>
		<link>http://largedata.wordpress.com</link>
	</image>
	<atom:link rel="search" type="application/opensearchdescription+xml" href="http://largedata.wordpress.com/osd.xml" title="My Blog" />
	<atom:link rel='hub' href='http://largedata.wordpress.com/?pushpress=hub'/>
		<item>
		<title>Data Stage Logging in 8.1</title>
		<link>http://largedata.wordpress.com/2008/12/19/data-stage-logging/</link>
		<comments>http://largedata.wordpress.com/2008/12/19/data-stage-logging/#comments</comments>
		<pubDate>Fri, 19 Dec 2008 21:59:58 +0000</pubDate>
		<dc:creator>Mridula</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[ACCESS DENIED: Project currently locked]]></category>
		<category><![CDATA[data stage]]></category>
		<category><![CDATA[DSParams]]></category>
		<category><![CDATA[ETL]]></category>
		<category><![CDATA[logging]]></category>
		<category><![CDATA[ORLogging]]></category>
		<category><![CDATA[RTLogging]]></category>

		<guid isPermaLink="false">http://largedata.wordpress.com/?p=7</guid>
		<description><![CDATA[We now have an enviornment set up and a few of us building flows using designer 8.1. At some point, you realize logging becoming a real issue. As in the job completes but the data is still being logged. Interesting find was that 8.1 uses the db to do the logging and everthing is stored [...]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=largedata.wordpress.com&amp;blog=5886228&amp;post=7&amp;subd=largedata&amp;ref=&amp;feed=1" width="1" height="1" />]]></description>
			<content:encoded><![CDATA[<p>We now have an enviornment set up and a few of us building flows using designer 8.1. At some point, you realize logging becoming a real issue. As in the job completes but the data is still being logged. Interesting find was that 8.1 uses the db to do the logging and everthing is stored in their xmeta database. so with multiple jobs and multiple users it quickly becomes a bottleneck. To make matters worse, a few of these tables seems like are temporary with no indexes.  Fortunately you have a way to turn back to has file logging. You can do this by switching rtlogging and orlogging.</p>
<p>The project specific DSParams has the rtlogging and orlogging parameters. you need to set RTLogging to 1 and ORLogging to 0</p>
<p> </p>
<p>Some errors we used to see because of performance of DB logging -</p>
<p><span style="font-size:x-small;font-family:Arial;"><span style="font-size:10pt;font-family:Arial;">When I tried to log in I got the following message:</span></span></p>
<p><span style="font-size:x-small;font-family:Arial;"><span style="font-size:10pt;font-family:Arial;">ACCESS DENIED: Project currently locked.</span></span></p>
<p><span style="font-size:x-small;font-family:Arial;"><span style="font-size:10pt;font-family:Arial;">The project is currently locked by the Administrator. Try again later or see your administrator.</span></span></p>
<p class="MsoNormal"><span style="font-size:small;font-family:Times New Roman;"><span style="font-size:12pt;"> additionally we would see the director just freeze up as we try to open the logs </span></span></p>
<p class="MsoNormal"><span style="font-size:small;font-family:Times New Roman;"><span style="font-size:12pt;">you could not rerun a job for a very long time after it was done, </span></span></p>
<p class="MsoNormal"><span style="font-size:small;font-family:Times New Roman;"><span style="font-size:12pt;">Job is not in a runnable state. this we learnt was because the logs were still being written long after job completed and the server thought the job is still active.</span></span></p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/largedata.wordpress.com/7/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/godelicious/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/delicious/largedata.wordpress.com/7/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gofacebook/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/facebook/largedata.wordpress.com/7/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gotwitter/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/twitter/largedata.wordpress.com/7/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gostumble/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/stumble/largedata.wordpress.com/7/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/godigg/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/digg/largedata.wordpress.com/7/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/goreddit/largedata.wordpress.com/7/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/reddit/largedata.wordpress.com/7/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=largedata.wordpress.com&amp;blog=5886228&amp;post=7&amp;subd=largedata&amp;ref=&amp;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://largedata.wordpress.com/2008/12/19/data-stage-logging/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:content url="http://0.gravatar.com/avatar/c28193f596bc079957d479adfcc1b42e?s=96&#38;d=identicon" medium="image">
			<media:title type="html">Mridula</media:title>
		</media:content>
	</item>
		<item>
		<title>Choosing an ETL tool</title>
		<link>http://largedata.wordpress.com/2008/12/19/choosing-an-etl-tool/</link>
		<comments>http://largedata.wordpress.com/2008/12/19/choosing-an-etl-tool/#comments</comments>
		<pubDate>Fri, 19 Dec 2008 08:35:43 +0000</pubDate>
		<dc:creator>Mridula</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://largedata.wordpress.com/?p=3</guid>
		<description><![CDATA[We started off on our process of selecting an ETL tool.  This tool would replace our inhouse java based data flow engine to load of Tlog and other large retail data. The evaluation process was geared towards measuring performance, scalability and the ability to quickly build configurable flows that works across customers. After the first [...]<img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=largedata.wordpress.com&amp;blog=5886228&amp;post=3&amp;subd=largedata&amp;ref=&amp;feed=1" width="1" height="1" />]]></description>
			<content:encoded><![CDATA[<p>We started off on our process of selecting an ETL tool.  This tool would replace our inhouse java based data flow engine to load of Tlog and other large retail data.</p>
<p>The evaluation process was geared towards measuring performance, scalability and the ability to quickly build configurable flows that works across customers. After the first round of evaluation we were left with the big 3, Ab Initio, Ascential Data Stage from IBM and Informatica.</p>
<p>We gave each of the vendors two of our current flows to implement in their tool in a week. We ranked them as AI, Data Stage, Informatica. While IBM was a not exactly a close second when it came to performance, with sufficient hardware, we felt we could get what we needed in terms of performance. They also seemed to have some cool features w.r.t to integrating to web applications etc.  of course closer to our budget which is equally important in these times. so Ascential Data Stage it is&#8230;</p>
<br />  <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gocomments/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/comments/largedata.wordpress.com/3/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/godelicious/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/delicious/largedata.wordpress.com/3/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gofacebook/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/facebook/largedata.wordpress.com/3/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gotwitter/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/twitter/largedata.wordpress.com/3/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/gostumble/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/stumble/largedata.wordpress.com/3/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/godigg/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/digg/largedata.wordpress.com/3/" /></a> <a rel="nofollow" href="http://feeds.wordpress.com/1.0/goreddit/largedata.wordpress.com/3/"><img alt="" border="0" src="http://feeds.wordpress.com/1.0/reddit/largedata.wordpress.com/3/" /></a> <img alt="" border="0" src="http://stats.wordpress.com/b.gif?host=largedata.wordpress.com&amp;blog=5886228&amp;post=3&amp;subd=largedata&amp;ref=&amp;feed=1" width="1" height="1" />]]></content:encoded>
			<wfw:commentRss>http://largedata.wordpress.com/2008/12/19/choosing-an-etl-tool/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:content url="http://0.gravatar.com/avatar/c28193f596bc079957d479adfcc1b42e?s=96&#38;d=identicon" medium="image">
			<media:title type="html">Mridula</media:title>
		</media:content>
	</item>
	</channel>
</rss>
