2016-12-08 04:47 EST

View Issue Details Jump to Notes ] Wiki ]
IDProjectCategoryView StatusLast Update
0012484mantisbtcsvpublic2016-12-06 08:58
Reporterbasil.mathew 
Assigned To 
PriorityhighSeverityminorReproducibilityhave not tried
StatusconfirmedResolutionfixed 
Product Version1.2.2 
Target VersionFixed in Version 
Summary0012484: CSV and Excel exporting issue...
DescriptionCSV and Excel exporting issue...

Excel Export is not working in linux os(openOffice 3.2.0) Actulally the file is got downloaded with xml extension but not shows anything while opens.the file contains xml nodes i see but not open in OpenOffice or in a browser.

Also The CSV export is not opening in windows (excel).Same issue is there.


Where CSV export is working in linux and Excel export is working in Windows client.


Is this becoz of any platform related issue?How to solve this issue?
Tagsmantishub
Attached Files

-Relationships
related to 0013370closedrombert CSV export specifies incorrect MIME type 
+Relationships

-Notes
atrol

~0027192

atrol (developer)

mantisbt-help mailing list Comment from David (dhx)
The "Excel Export" feature uses the deprecated (and completely useless)
Excel XP-2003 format as described here:
http://en.wikipedia.org/wiki/Microsoft_Office_XML_formats

AFAIK OpenOffice doesn't support this format.
rombert

~0029916

rombert (developer)

Can you retry CSV export with latest 1.2.x code from Git? It should open in Excel just fine.
grangeway

~0031067

grangeway (reporter)

1.3 will generate excel files in office 2007/2010 format so should resolve this issue - I too used to have the same problem in the 1.2.x releases
atrol

~0031074

atrol (developer)

Reminder sent to: grangeway

I don't see any format difference between 1.2 and 1.3
Are you talking about non commited changes?
atrol

~0031121

atrol (developer)

Reopened
atrol

~0031461

atrol (developer)

Reopened, the issue is not fixed in master branch at the
official repository.
There is no patch / changeset attached. This will confuse any user who has a look at this issue.
grangeway

~0033294

grangeway (reporter)

this is fixed in the mantis-2.x branch
rombert

~0033296

rombert (developer)

0012484:0031461 is still valid, reopening
rombert

~0036532

rombert (developer)

Atrol's comment is still valid, reopening.
grangeway

~0036535

grangeway (reporter)

see the master-2.0.x branch for fix
vboctor

~0042192

vboctor (manager)

This is reproducible on 1.3.x release on other platforms as well.
dregad

~0042197

dregad (developer)

Grangeway wrote code [1] to fix the Excel/CSV exports using PHPExcel library. I have not tested it, although I've used PHPExcel for other purposes and found it to be a good tool.

The commit does not apply cleanly on master, but it's probably worth using that rather than writing something from scratch. I did not check whether there are any follow-up commits in the master-2.0.x branch [2] either.

[1] https://github.com/mantisbt/mantisbt/commit/69456d94bf93196e97b624258259f084b9993fa3
[2] https://github.com/mantisbtarchive/mantisbt/tree/master-2.0.x
cproensa

~0054530

cproensa (developer)

Until recently i could open the xml generated files with librOffice.
But now i cant...

Anyway, maybe it's time to work a better solution...
cproensa

~0054684

cproensa (developer)

I have tried a quick implementation with PHPExcel but i see some downsides:
+ very easy to work with.
- A quite big include library. It has a lot of functionality, of which we would only use a small part of it: just the excel writer, and using only simple formats
- Relatively high memory usage. As it writes an in memory object before outputting as a final document, memory increases linearly with data size.
- Slow, due to the complex features (which are not actually needed)

Another library that i reviewed: Spout (https://github.com/box/spout)
+ Seems to be active and well supported.
+ Simple xlsx/ods writer, no in-memory buffer, but uses filesystem to stream and zip the xml as part of the format specification.
+ very low memory usage, constant usage.
+ very fast
- licensed as Apache 2, which is not suitable to be included in GPL project
dregad

~0054690

dregad (developer)

Having looked at various other Excel libraries for PHP in the past for another project, PHPExcel was the only one I found that has good, active support and keeps evolving. I also tried one called SimpleExcel (on Github) which is more lightweight, but has not been updated since 2013.

PHPExcel

> - A quite big include library.

Is that really an issue ? Disk space is cheap...

> It has a lot of functionality, of which we would only use a small part

True, but not really relevant IMO

> Relatively high memory usage

I have never used PHPExcel for very large exports (the biggest files I ever generated were a few hundred rows at most) so I did not experience any issues with memory usage or performance.

Did you reach any limits performing large exports ?

> Slow

What is the definition of "slow" ? When extracting a large amount of data, I believe it is acceptable to have to wait a few seconds for the file to be generated.


Spout

> licensed as Apache 2, which is not suitable to be included in GPL project

I think you got that backwards... My understanding, which seems to be confirmed by FSF [1][2] is that it is acceptable to include an Apache2 library into a GPL (v3) project, but the reverse is not true. MantisBT is released under GPL "version 2 of the License, or (at your option) any later version." so I think we should be OK - but IANAL ;)


[1] http://www.gnu.org/licenses/license-list.html#apache2
[2] https://www.apache.org/licenses/GPL-compatibility.html
cproensa

~0054693

cproensa (developer)

Last edited: 2016-12-06 06:16

View 3 revisions

> Did you reach any limits performing large exports ?
> What is the definition of "slow"

I don't have a benchmark atm. But "very noticeable" slower.
Memory is linear so it will grow with size, i reached limits at some-10ks, iirc

if interested i can refresh with actual numbers.


> it is acceptable to include an Apache2 library into a GPL (v3) project

True, but not into a GPL2. As far as i know, current license is GPL2

cproensa

~0054698

cproensa (developer)

Last edited: 2016-12-06 08:58

View 2 revisions

@dregad

In this order:
Mantis-csv	Mantis-excel	Spout-xlsx	PHPexcel-xlsx

time in seconds, memory in MB

2400 bugs				
time	4,2	4,9	6,1	12,5
memory	10,00	8,19	10,00	38,50

10k bugs				
time	19,9	17,5	25,7	56,8
memory	10,00	13,94	10,00	127,83

50k bugs				
time	194,7	81,3	120,9	NA
memory	20,80	56,75	12,00	NA


PHPExcel breaks when reaching 128MB at ~30k bugs, but i'm not sure that after 10k it's actually working, since at that point the memory has reached maximum and stops growing.

The memory increase is due to output buffering and/or library overhead.
Bug cache is constant in memory usage, as seen with Spout since this library use filesystem to buffer the output.

+Notes

-Issue History
Date Modified Username Field Change
2010-10-26 05:42 basil.mathew New Issue
2010-10-29 05:29 atrol Note Added: 0027192
2011-10-05 18:58 rombert Relationship added related to 0013370
2011-10-05 18:59 rombert Note Added: 0029916
2011-10-05 18:59 rombert Status new => feedback
2012-01-27 17:31 grangeway Note Added: 0031067
2012-01-27 17:31 grangeway Status feedback => resolved
2012-01-27 17:31 grangeway Fixed in Version => 1.3.0-beta.1
2012-01-27 17:31 grangeway Resolution open => fixed
2012-01-27 17:31 grangeway Assigned To => grangeway
2012-01-29 10:26 atrol Note Added: 0031074
2012-01-30 04:03 wpionka Tag Attached: lkkjkjjlklk jj klkklljkkkh
2012-02-04 11:47 atrol Tag Detached: lkkjkjjlklk jj klkklljkkkh
2012-02-04 11:48 atrol Note Added: 0031121
2012-02-04 11:48 atrol Status resolved => feedback
2012-02-04 11:48 atrol Resolution fixed => reopened
2012-02-28 13:29 grangeway Status feedback => closed
2012-02-28 13:29 grangeway Resolution reopened => fixed
2012-03-14 18:06 atrol Note Added: 0031461
2012-03-14 18:06 atrol Status closed => feedback
2012-03-14 18:06 atrol Resolution fixed => reopened
2012-10-20 20:00 grangeway Note Added: 0033294
2012-10-20 20:00 grangeway Status feedback => resolved
2012-10-20 20:00 grangeway Resolution reopened => fixed
2012-10-21 07:04 rombert Assigned To grangeway =>
2012-10-21 07:04 rombert Note Added: 0033296
2012-10-21 07:04 rombert Status resolved => feedback
2012-10-21 07:04 rombert Resolution fixed => reopened
2013-04-06 09:37 dregad Fixed in Version 1.3.0-beta.1 =>
2013-04-06 09:37 dregad Description Updated View Revisions
2013-04-06 15:19 grangeway Status feedback => resolved
2013-04-06 15:19 grangeway Fixed in Version => 1.3.0-beta.1
2013-04-06 15:19 grangeway Resolution reopened => fixed
2013-04-06 15:19 grangeway Assigned To => grangeway
2013-04-07 10:45 rombert Note Added: 0036532
2013-04-07 10:45 rombert Status resolved => feedback
2013-04-07 10:45 rombert Resolution fixed => reopened
2013-04-07 13:15 grangeway Note Added: 0036535
2013-04-07 13:15 grangeway Status feedback => closed
2013-04-07 13:15 grangeway Resolution reopened => fixed
2013-04-07 18:46 grangeway Status closed => resolved
2013-04-27 16:42 atrol Assigned To grangeway =>
2013-04-27 16:42 atrol Status resolved => feedback
2013-04-27 16:42 atrol Fixed in Version 1.3.0-beta.1 =>
2015-01-18 22:50 vboctor Tag Attached: mantishub
2015-01-18 22:51 vboctor Status feedback => confirmed
2015-01-18 22:51 vboctor Target Version => 1.3.0-beta.2
2015-01-18 22:51 vboctor Note Added: 0042192
2015-01-19 03:28 dregad Note Added: 0042197
2015-03-15 19:59 dregad Target Version 1.3.0-beta.2 => 1.3.0-beta.3
2015-04-18 18:33 vboctor Severity major => minor
2015-09-06 17:47 vboctoradmin Target Version 1.3.0-beta.3 => 1.3.0-rc.1
2016-01-12 03:43 atrol Target Version 1.3.0-rc.1 => 1.3.0-rc.2
2016-06-12 02:37 atrol Target Version 1.3.0-rc.2 => 1.3.0
2016-06-22 02:21 albani Issue cloned: 0021145
2016-07-10 07:57 atroladmin Target Version 1.3.0 => 1.3.1
2016-07-11 15:40 atrol Target Version 1.3.1 =>
2016-11-15 15:57 cproensa Note Added: 0054530
2016-12-05 17:18 cproensa Note Added: 0054684
2016-12-06 05:35 dregad Note Added: 0054690
2016-12-06 06:15 cproensa Note Added: 0054693
2016-12-06 06:15 cproensa Note Edited: 0054693 View Revisions
2016-12-06 06:16 cproensa Note Edited: 0054693 View Revisions
2016-12-06 08:54 cproensa Note Added: 0054698
2016-12-06 08:58 cproensa Note Edited: 0054698 View Revisions
+Issue History