Author Topic: SRTM3 MakeAHMap discrepancies  (Read 3875 times)

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #15 on: April 01, 2021, 07:25:36 AM »
Okay, will do.

Probably tomorrow as it's late.

Oh, and keep in mind that it is the new esa data.
« Last Edit: April 01, 2021, 07:30:04 AM by Easyscor »
Easy in-game again.
Since Tour 19 - 2001

Offline artik

  • Silver Member
  • ****
  • Posts: 1906
      • Blog
Re: SRTM3 MakeAHMap discrepancies
« Reply #16 on: April 01, 2021, 07:32:02 AM »
Oh, and keep in mind that it is the new esa data.

So try to use SRTM3 as is with new location
Artik, 101 "Red" Squadron, Israel

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #17 on: April 01, 2021, 07:43:39 AM »
Same result

The first 5 lines of that download file read as follows:
srtm3/N00E006.hgt zip N00E006.hgt - http://srtm.motoroute.me/SRTM3/Africa/N00E006.hgt.zip
srtm3/N00E009.hgt zip N00E009.hgt - http://srtm.motoroute.me/SRTM3/Africa/N00E009.hgt.zip
srtm3/N00E010.hgt zip N00E010.hgt - http://srtm.motoroute.me/SRTM3/Africa/N00E010.hgt.zip
srtm3/N00E011.hgt zip N00E011.hgt - http://srtm.motoroute.me/SRTM3/Africa/N00E011.hgt.zip
srtm3/N00E012.hgt zip N00E012.hgt - http://srtm.motoroute.me/SRTM3/Africa/N00E012.hgt.zip

Wait, I forgot to empty the data folder
Easy in-game again.
Since Tour 19 - 2001

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #18 on: April 01, 2021, 07:53:12 AM »
MUCH BETTER.

That data set works, of course. It still leaves the issue of the esa obfuscating the original srtm3 format, in at least 2 directions as far as I can tell in preliminary inspection.
« Last Edit: April 01, 2021, 07:56:43 AM by Easyscor »
Easy in-game again.
Since Tour 19 - 2001

Offline artik

  • Silver Member
  • ****
  • Posts: 1906
      • Blog
Re: SRTM3 MakeAHMap discrepancies
« Reply #19 on: April 01, 2021, 09:07:37 AM »
MUCH BETTER.

That data set works, of course. It still leaves the issue of the esa obfuscating the original srtm3 format, in at least 2 directions as far as I can tell in preliminary inspection.

give me a link to the ESA data please?
Artik, 101 "Red" Squadron, Israel

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #20 on: April 01, 2021, 11:35:43 AM »
https://step.esa.int/auxdata/dem/SRTMGL1/

Googling "SRTMGL1 format" returns a page of links explaining some of the changes. The hgt extension stands for height. It has replaced the old digital elevation, dem extension.
Easy in-game again.
Since Tour 19 - 2001

Offline JimmyD3

  • Gold Member
  • *****
  • Posts: 3757
Re: SRTM3 MakeAHMap discrepancies
« Reply #21 on: April 01, 2021, 12:22:58 PM »
That fixed the corrugations on my DFW map, it looks awesome. The topography is beautiful.  :x
Kenai77
CO Sic Puppies MWK
USAF 1971-76

Offline artik

  • Silver Member
  • ****
  • Posts: 1906
      • Blog
Re: SRTM3 MakeAHMap discrepancies
« Reply #22 on: April 03, 2021, 01:28:17 AM »
https://step.esa.int/auxdata/dem/SRTMGL1/

Googling "SRTMGL1 format" returns a page of links explaining some of the changes. The hgt extension stands for height. It has replaced the old digital elevation, dem extension.

Actually it is not 3 arc second map but rather 1 arc-second accuracy map in same format.

the SRTM3 includes 1201x1201 16 bit integer numbers for each 1 by 1 degree time

this data includes 3601x3601 16 bit integer numbers for each 1 by 1 degree time that means it has much higher resolution but of course it isn't compatible with previous data that is why it didn't work for you.

Interesting maybe I can add it  :headscratch:
Artik, 101 "Red" Squadron, Israel

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #23 on: April 03, 2021, 03:46:31 AM »
Wow. That never occurred to me. Sure explains why that set didn't look right.  :rofl
Easy in-game again.
Since Tour 19 - 2001

Offline captain1ma

  • Aces High CM Staff
  • Plutonium Member
  • *******
  • Posts: 14297
      • JG54 website
Re: SRTM3 MakeAHMap discrepancies
« Reply #24 on: August 23, 2021, 06:02:17 PM »
bad new, its broken again. website says they're doing updates, but its been down for 2 days.
this one has old data, but it seems to be up and running:

https://www.iea-software.com/ftp/Emeraldv6/Geography/Eurasia/Elevations/SRTM3/

Offline artik

  • Silver Member
  • ****
  • Posts: 1906
      • Blog
Re: SRTM3 MakeAHMap discrepancies
« Reply #25 on: August 25, 2021, 01:10:06 AM »
bad new, its broken again. website says they're doing updates, but its been down for 2 days.
this one has old data, but it seems to be up and running:

https://www.iea-software.com/ftp/Emeraldv6/Geography/Eurasia/Elevations/SRTM3/

Ok... if it does not go back I'll update sources to the link you suggested.

@hitech

Maybe you can provide a mirror for these files such that community will not have to run after the new links each time one of the servers is down?
Artik, 101 "Red" Squadron, Israel

Offline artik

  • Silver Member
  • ****
  • Posts: 1906
      • Blog
Re: SRTM3 MakeAHMap discrepancies
« Reply #26 on: August 29, 2021, 01:07:50 AM »
bad new, its broken again. website says they're doing updates, but its been down for 2 days.
this one has old data, but it seems to be up and running:

https://www.iea-software.com/ftp/Emeraldv6/Geography/Eurasia/Elevations/SRTM3/

Ohhhh...

it is different layout https://www.iea-software.com/ftp/Emeraldv6/Geography/Africa/Elevations/SRTM3/

For example before

http://srtm.motoroute.me/SRTM3/Eurasia/N00E072.hgt.zip

New

https://www.iea-software.com/ftp/Emeraldv6/Geography/Eurasia/Elevations/SRTM3/N00E072.hgt.zip

looks like they changed order of directories... need to rewrite it all  :(

EDIT

The problem actually bigger since SRTM30 is down as well (same mirror) and new one does not have it.

So need to search a new mirror with all the data ASAP.

Currently GTOPO30 is only usable DB but it is much less accurate
« Last Edit: August 29, 2021, 01:15:41 AM by artik »
Artik, 101 "Red" Squadron, Israel

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #27 on: August 29, 2021, 03:17:02 AM »
Unfortunately this how the "stakeholders" protect their turf. Never mind that taxpayers pay for their equipment, including the satellites, and often their salaries through government grants when not paid directly by "state" University.

Hopefully they've updated to fill voids and corrected where they can shoot through the tree cover without format changes in the middle of each data set. I've seen that previously.

Here's hoping you find a smooth transition without too much in the way of obfuscation.  :pray
Easy in-game again.
Since Tour 19 - 2001

Offline artik

  • Silver Member
  • ****
  • Posts: 1906
      • Blog
Re: SRTM3 MakeAHMap discrepancies
« Reply #28 on: August 29, 2021, 06:10:40 AM »
Currently I can find online SRTM1: https://step.esa.int/auxdata/dem/SRTMGL1/ and GTOPO30

Problem SRTM1 is too large and not really needed GTOTO30 much less sharp than SRTM30 (needed for N>60)

So please find new mirrors ASAP. I assume hitech will be able to help us with storage so the data will not disappear every year...
Artik, 101 "Red" Squadron, Israel

Offline Easyscor

  • Plutonium Member
  • *******
  • Posts: 10880
Re: SRTM3 MakeAHMap discrepancies
« Reply #29 on: August 29, 2021, 02:52:39 PM »
I suspect you’ve already done considerable work looking for the files. Every NASA and USGS link I followed is now dead. What I did find may only be in ARC Grid or ARC ASCII format pushed by ARCGIS or ASTRA(sp?).

Probably the first thing I should tell you is that after my experience watching the USGS relocate their data every year or so, I used your program to download the entire global dataset from whichever working site was available at the time, version 2_2. I don’t remember if its zipped or not, .htg and 3.5 GB, but if you can find a site to store it, I’m willing to reinstall an ftp program and upload the folder.

I did find an interesting site, vterrain.org, with links to ftp download pages, which I copied as there is a difference between clicking their links and copying the links into a web browser. For what it might be worth...

http://vterrain.org/Elevation/SRTM/
ftp://ftp.glcf.umiacs.umd.edu/glcf/SRTM/
ftp://srtm.csi.cgiar.org/SRTM_v41/

I'm guessing you've found the CGIAR site. Nope, not looking very useful, but I don't currently have an ftp program installed to test the CGIAR links mentioned above from the vterrain.org site. (https://srtm.csi.cgiar.org/)

It looks like someone in government decided to offload handling of the data to a “community organization”, CGIAR / CIAT-CSI. If anyone else if hosting, I didn’t find it in my morning of searching. To me, it looks like name-in-lights for the organization and it’s head honcho if you use their service for non-commercial use. Like I said, that’s what it looks like to me.

Perhaps you can contact him and let him know what you’d like to do. Heck, he might hire you. They’ve apparently updated the data for shorelines and smoothed over voids. He calls it version 4.1.

The one interesting page I did find looks like it will be unusable as it seems to require manual downloads per tile, but they have the data and that ftp link might be key.

The README file of the srtm_31_05.zip file I downloaded from https://www.usna.edu/Users/oceano/pguth/md_help/html/srtm.htm says this:

The data distributed here are in  ARC GRID,  ARC ASCII  and Geotiff format, in
decimal degrees and datum WGS84.  They are derived from the USGS/NASA SRTM data.

DISTRIBUTION

Users are  prohibited from  any commercial,  non-free resale,  or redistribution
without explicit written permission from CIAT. Users should acknowledge CIAT  as
the source used  in the creation  of any reports,  publications, new data  sets,
derived products, or services resulting from the use of this data set. CIAT also
request  reprints of  any publications  and notification  of any  redistributing
efforts.   For commercial  access to  the data,  send requests  to Andy   Jarvis
(a.jarvis@cgiar.org).    [NOTE: this is he same guy at CGIAR]

Once unzipped, I found the readme, a 5 line prj text file and the 886KB .asc ASCII file, started out this way:

ncols         6000
nrows         6000
xllcorner     -30
yllcorner     35
cellsize      0.00083333333333333
NODATA_value  -9999
-9999 -9999 -9999 -9999 -9999 -9999…

A UTube video made EarthExplorer look interesting but not particular useful for your program.
Easy in-game again.
Since Tour 19 - 2001