WARDY IT Solutions - [SQLDownUnder] Perfmon csv import into SSIS

WARDY IT Solutions » Administrators » SQL Downunder List Archive » [SQLDownUnder] Perfmon csv import into SSIS

[SQLDownUnder] Perfmon csv import into SSIS

Last post 08-21-2008, 11:15 AM by kevin Swain. 3 replies.


	Sort Posts: Previous Next

08-20-2008, 12:45 PM 9998

kevin Swain

[SQLDownUnder] Perfmon csv import into SSIS

Hi,

I am trying to import Perfmon counter data that is in the CSV format. Does anyone know how to transform this file into 3 fields

for example

Counter Name, Date time, Value

This will allow me is easly import the data using SSIS

--

Regards,

Kevin Swain

to unsubscribe to this list, please send a message back to the list with 'unsubscribe' as the subject. Powered by mailenable.com - List managed by http://www.readify.net

08-21-2008, 10:52 AM 10009 in reply to 9998

jasonlove.mail@gmail.com

Re: [SQLDownUnder] Perfmon csv import into SSIS

SQLH2 does some of this for you.

Sent via BlackBerry by AT&T

From: Greg Linwood <GregL@...>
Date: Thu, 21 Aug 2008 10:35:54 +1000
To: SQLDownUnder@...<SQLDownUnder@...>
Subject: RE: [SQLDownUnder] Perfmon csv import into SSIS

Hi Kevin

I've never used SSIS to do this, but I guess the big question here is whether the counters in each file will change? If you know the columns will always be the same, it would be fairly easy to create a package or even a simple bulk insert script. If they change, you might need something more sophisticated - one very handy tool for this is relog.exe, which I blogged about a couple of years back here:

http://blogs.sqlserver.org.au/blogs/greg_linwood/archive/2006/01/30/53.aspx

You could build from this script a way of logging your counters to whatever persisted tables you need to.

Have you considered logging perfmon data directly to tables instead of via files? This would make scripting the solution significantly easier as your source data would already be in SQL tables...

Regards

Greg Linwood |Managing Director

MyDBA | SQL Servants

Level 13 | 499 St Kilda Rd |Melbourne VIC 3004

p+61 3 9864 6999 |m +61 408 899 515 | f+61 3 9804 5488

gregl@mydba.com |www.mydba.com

From: SQLDownUnderList@... [SQLDownUnderList@...] On Behalf Of kevin Swain [kevswain@...]
Sent: Wednesday, 20 August 2008 12:37 PM
To: SQLDownUnder@...
Subject: [SQLDownUnder] Perfmon csv import into SSIS

Hi,

I am trying to import Perfmon counter data that is in the CSV format. Does anyone know how to transform this file into 3 fields

for example

Counter Name, Date time, Value

This will allow me is easly import the data using SSIS

--

Regards,

Kevin Swain

to unsubscribe to this list, please send a message back to the list with 'unsubscribe' as the subject. Powered by mailenable.com - List managed by http://www.readify.net

This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal

to unsubscribe to this list, please send a message back to the list with 'unsubscribe' as the subject. Powered by mailenable.com - List managed by http://www.readify.net hº{.nÇ+‰·¢Øb²X¬¶™^jÇ¬zwZ™ë,j›iÉ-¢Ø^–+-Â+aº{.nÇ+‰·š²Ø^²æãyËO£«yÖò™¨¥zv›•ç(˜¸¬¶f§jo(m¶ŸÿÃ+y§b)Þ

08-21-2008, 11:07 AM 10010 in reply to 9998

Nicholas_Beagley@amp.com.au

Re: [SQLDownUnder] Perfmon csv import into SSIS

Return Receipt

Your Re: [SQLDownUnder] Perfmon csv import into SSIS
document:

was Nicholas Beagley/AU/AMP
received
by:

at: 21/08/2008 11:04:11 AM

This email message and any accompanying attachments may contain information that is confidential and is subject to legal privilege. If you are not the intended recipient, do not read, use, disseminate, distribute or copy this message or attachments. If you have received this message in error, please notify the sender immediately and delete this message. Any views expressed in this message are those of the individual sender, except where the sender expressly, and with authority, states them to be the views of AMP. Before opening any attachments, please check them for viruses and defects.

to unsubscribe to this list, please send a message back to the list with 'unsubscribe' as the subject. Powered by mailenable.com - List managed by http://www.readify.net

08-21-2008, 11:15 AM 10011 in reply to 9998

kevin Swain

Re: [SQLDownUnder] Perfmon csv import into SSIS

Thanks Greg,

For most of our customers we are login the perf data into a table however on a 2k OS server this is not possible. I am now looking at using WMI to replace perfmon counters as this may be a better option for us.

Kevin

2008/8/21 Greg Linwood <GregL@...>

Hi Kevin

I've never used SSIS to do this, but I guess the big question here is whether the counters in each file will change? If you know the columns will always be the same, it would be fairly easy to create a package or even a simple bulk insert script. If they change, you might need something more sophisticated - one very handy tool for this is relog.exe, which I blogged about a couple of years back here:

http://blogs.sqlserver.org.au/blogs/greg_linwood/archive/2006/01/30/53.aspx

You could build from this script a way of logging your counters to whatever persisted tables you need to.

Have you considered logging perfmon data directly to tables instead of via files? This would make scripting the solution significantly easier as your source data would already be in SQL tables...

Regards

Greg Linwood | Managing Director

MyDBA | SQL Servants

Level 13 | 499 St Kilda Rd | Melbourne VIC 3004

p +61 3 9864 6999 | m +61 408 899 515 | f +61 3 9804 5488

greglGregL@... | www.mydba.com

From: GregL@... [GregL@...] On Behalf Of kevin Swain [GregL@...]
Sent: Wednesday, 20 August 2008 12:37 PM
To: GregL@...
Subject: [SQLDownUnder] Perfmon csv import into SSIS

Hi,

I am trying to import Perfmon counter data that is in the CSV format. Does anyone know how to transform this file into 3 fields

for example

Counter Name, Date time, Value

This will allow me is easly import the data using SSIS

Regards,

Kevin Swain
to unsubscribe to this list, please send a message back to the list with 'unsubscribe' as the subject. Powered by mailenable.com - List managed by http://www.readify.net