<p>I was browsing <a href="https://stackoverflow.com/questions/5119/what-are-the-best-rss-feeds-for-programmersdevelopers">this thread</a>, which has good recommendation but a bit too general for me.</p>

<p>So, if anyone has a collection of nice game programming feeds,please share them. :)</p>

<p>(both general and specific topics are welcome)</p>

If you are catpuring logging information for future searching and anaylsis perhaps a database would be a better answer.
As for your solution.  Flat files do not scale well at all where as a database scale much better.  I wouldn't split the files either, that just compounds the scalability issue.  If you have to use a flat file I would probably try keeping the meta data in a csv (less over head) and the data in a series of files indexed by the csv file.  That way all the data doesn't impact your index file.  Just my thoughts.