# Duplicate.X message in dataview

**URL:** <https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283>\
**Category:** General Discussion\
**Tags:** active-console\
**Created:** [16 May 2024 16:18 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283 "2024-05-16T16:18:58Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Hector](https://avatars.discourse-cdn.com/v4/letter/h/43a26b/32.png) [@Hector](https://community.itrsgroup.com/u/Hector)\
**Post date:** [16 May 2024 16:18 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/1 "2024-05-16T16:18:58Z")

</div>

Hi Team,  
I need to show the information about a file in linux server without the message “Duplicate.x” repetead

The sampler code says this:  
#! /usr/bin/bash  
echo “Row,Descripcion”  
/bin/cat /tmp/pnum47333.txt

Plugin: toolkit

Regards!

 ![selectndm1](https://europe1.discourse-cdn.com/flex013/uploads/itrsgroup/original/1X/b03b68ce191d8c3f97486d2dc7cb45a3a0ba75e0.png)  
 ![selectndm](https://europe1.discourse-cdn.com/flex013/uploads/itrsgroup/original/1X/633d8387818012a972fa96aec1398daa0e7f02aa.png)

---

<div class="post-metadata">

**Author:** ![pgalbavy](https://dub1.discourse-cdn.com/flex013/user_avatar/community.itrsgroup.com/pgalbavy/32/15_2.png) [@pgalbavy](https://community.itrsgroup.com/u/pgalbavy)\
**Post date:** [16 May 2024 16:23 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/2 "2024-05-16T16:23:52Z")

</div>

Hi!

The first column in Geneos dataview tables is “special” and is not normal data, but instead a label that refers to the other cells in the same row. For this reason it must be unique. If a second row comes in the with the same first column then you get `_duplicateX` appended to it, as you have seen.

Looking at your dataview, your are not processing the data into Geneos data cells, but instead just sending the data in as text.

If you process the text and break it down into “useful” cells and ensure that the rowname (first column) is informative and unique, then you will get better results.

The rowname should also be used to identify the same data from one sample to the next, so while plugins like SQL-Toolkit can add incremental numeric rowname, this isn’t useful if the data in the other cells in that row move up and down.

Hope this helps.

---

<div class="post-metadata">

**Author:** ![Hector](https://avatars.discourse-cdn.com/v4/letter/h/43a26b/32.png) [@Hector](https://community.itrsgroup.com/u/Hector)\
**Post date:** [16 May 2024 16:54 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/3 "2024-05-16T16:54:41Z")

</div>

Hi Pete,

Thanks for you answer. Do you have any examples to try?  
You said “If you process the text and break it down into “useful” cells and ensure that the rowname (first column) is informative and unique, then you will get better results.”  
How would it be?

Thanks in advance!  
Regards

---

<div class="post-metadata">

**Author:** ![pgalbavy](https://dub1.discourse-cdn.com/flex013/user_avatar/community.itrsgroup.com/pgalbavy/32/15_2.png) [@pgalbavy](https://community.itrsgroup.com/u/pgalbavy)\
**Post date:** [17 May 2024 07:34 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/4 "2024-05-17T07:34:39Z")

</div>

Looking at the screenshots you have on your OP, I suggest pivoting the output of the underlying reporting command into columns, perhaps using the “Record ID” as the rowname and then using the other lines as key / value pairs to create columns in your shell script.

As I don’t know the source of the data or how regular the field values are I cannot suggest the best approach to this, but if the source is a SQL query, then each column of the SQL query would normally be a Geneos dataview column, with a unique value being the first column.

So, you would have columns like “Process Name”, “Process Number” etc.

Depending on your previous experience, UNIX/Linux test processing tools like awk/sed/perl may help. If you can do the hard work nearer the source of the data, then even better.

Toolkit accepts an extended CSV format, but the column headings must be the first row. After that you can send matching data lines and also “headlines” as per the toolkit docs.

Peter

---

<div class="post-metadata">

**Author:** ![Hector](https://avatars.discourse-cdn.com/v4/letter/h/43a26b/32.png) [@Hector](https://community.itrsgroup.com/u/Hector)\
**Post date:** [17 May 2024 12:49 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/5 "2024-05-17T12:49:14Z")

</div>

Hi Peter,

The source of the data is an output format txt in Linux. I run a command that run a Select Static from Connect Direct(ndm). The source is not a SQL query.  
I use toolkit plugin. Do you have any examples?

Regards

---

<div class="post-metadata">

**Author:** ![Hector](https://avatars.discourse-cdn.com/v4/letter/h/43a26b/32.png) [@Hector](https://community.itrsgroup.com/u/Hector)\
**Post date:** [27 May 2024 13:06 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/6 "2024-05-27T13:06:00Z")

</div>

In linux I try with this solution with awk

/bin/cat /tmp/pnum47333.txt| awk ‘{print NR-1 “,” $0}; END {print “\<!\>rowCount,” NR-1}’

Is there any way to create the ouput?

In windows, what Can create the output?

Regards

---

<div class="post-metadata">

**Author:** ![pgalbavy](https://dub1.discourse-cdn.com/flex013/user_avatar/community.itrsgroup.com/pgalbavy/32/15_2.png) [@pgalbavy](https://community.itrsgroup.com/u/pgalbavy)\
**Post date:** [28 May 2024 14:58 UTC](https://community.itrsgroup.com/t/duplicate-x-message-in-dataview/283/7 "2024-05-28T14:58:08Z")

</div>

I would imaging Powershell would help, but I am very much not familiar with PS, sorry!

You can install UNIX tools like `awk` on Windows, but that may be overkill if Powershell can do the same natively.
