Defect #1265

Unable to download BIG order file with remote storage (curlHelper)

Added by Blatti Yves over 3 years ago. Updated about 3 years ago.

Status:ClosedStart date:02/15/2016
Priority:HighDue date:
Assignee:-% Done:

100%

Category:SHOP
Target version:4.4.0
Affected version:4.3.0

Description

Local big file can be downloaded easyli now (#1149 & #1226) but remote files are stored in memory by cURL before being written to client.
We should stream data to client to avoid memory problems...

History

#1 Updated by Blatti Yves about 3 years ago

This is a general problem of the curlHelper in easySDI libraries.
The files are downloaded in memory entirely before being sent to client.

I propose to stream the result directly to client.

The only downside is the the http header Content-Length cannot be sent since size cannot be calculated, but we'll not be limited by php/server memory limitations anymore.

#2 Updated by Blatti Yves about 3 years ago

  • Status changed from New to Affected

#3 Updated by Blatti Yves about 3 years ago

okay, I made small adaptations in curlHelper, it now "streams" (write to client data blocks from curl and flush buffer).
I tested it with:
  • MAP
    • WMS via php proxy
    • WFS via PHP proxy
  • SHOP
    • Download from remote file (MD link in catalog)
      • Single file
      • Grid
      • With and without authentication
    • Download a remote order-diffusion file
  • the URL tester

#4 Updated by Blatti Yves about 3 years ago

  • Subject changed from Unable to download BIG order file with remote storage to Unable to download BIG order file with remote storage (curlHelper)

#5 Updated by Blatti Yves about 3 years ago

  • Status changed from Affected to Resolved
  • Target version set to 4.4.0
  • % Done changed from 0 to 100

rev. 9496

#6 Updated by Blatti Yves about 3 years ago

  • Status changed from Resolved to To merge

#7 Updated by Blatti Yves about 3 years ago

  • Assignee changed from Blatti Yves to Van Hoecke Hélène

#8 Updated by Van Hoecke Hélène about 3 years ago

  • Assignee deleted (Van Hoecke Hélène )

#9 Updated by Van Hoecke Hélène about 3 years ago

  • Status changed from To merge to Closed

Also available in: Atom PDF