Aces High Bulletin Board

General Forums => Terrain Editor => Topic started by: artik on February 15, 2017, 03:48:27 PM

Title: MakeAHMap 1.11 Released
Post by: artik on February 15, 2017, 03:48:27 PM
2017-02-15: Version 1.11

- Fixed bug with not ignoring BOM for files in UTF-8 format with BOM

  Now there is no need to save file as ANSI

- Added workaround for non-reporducable crash issue during splattype filtering.
 
  @NatCigg can you please check that the new version does not crash?


- Fixed download sourses for gshhs and gtopo30 - not gtopo30 can be used again
- Fixed bug makeahmap didn't use command line argument for custom configuration file
Title: Re: MakeAHMap 1.11 Released
Post by: 68falcon on February 15, 2017, 04:52:43 PM
Link ?
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 15, 2017, 05:22:54 PM
Here is the direct link to 1.11

http://cppcms.com/files/makeahmap/makeahmap-1.11.zip
Title: Re: MakeAHMap 1.11 Released
Post by: USRanger on February 15, 2017, 09:09:27 PM
Thanks! :aok
Title: Re: MakeAHMap 1.11 Released
Post by: NatCigg on February 16, 2017, 07:03:08 AM
at this point the program quit working...

- Loading Profile from config.ini
  map_size=512
  map_name=miter
  tile_set=europe
  dem=srtm3
  lat=45.15
  lon=-84.8
  scale=1.0
- Checking for makeahmap updates... 1.11 is up to date
- Version: 1.11
Cleaning temporary directory:
- Removed: cleanup_script.bat
- Removed: update_save.exe
- Latitude, longitude range and scale
    Lat:     41.442     48.858
    Lon:    -90.057    -79.543
  Scale:      1.000
- Loading ground type mapping europe.csv
- Loading GlobCover Data.
- Loading Digital Elevations Model data.
- Loading & processing shores data.
-- Total segments:903174, maximal segment lenght:40.140
- Loading & processing rivers data...
--- Total river segments: 1542; max river segment length 4.260
  Complete
- Updateing altitudes...
-- Converting water bodies to elevations map
--- Iceles and Lakes
--- Rivers
-- Calculating elevation modifications to bring water to 0 feet
   Using:OpenCL solver running on GPU: GeForce GTX 745; computing units=3

         Grid|  Vertices| Time (s)|Iterations| Bandwidth GB/s
      256x256|     44145|    0.063|       176|    5.879
      512x512|    176255|    0.141|       200|   13.499
    1024x1024|    704485|    0.688|       357|   18.023
    2048x2048|   2816894|    3.875|       569|   20.135
    4096x4096|  11265417|   20.327|       773|   20.861

    Total optimization time 25.093 s
    Maximal correction  range max=1823.000 min=0.000
    Maximal land modificationt to below 0 alt 564
- Fixing ground types...  using sse4.2
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 16, 2017, 07:32:51 AM
I got the same issue that NatCigg go with 1.11, it quit working at the same point. So I went and tried one of the coordinates back in 1.9 I previously used and same thing happened instead of coordinates for a map I had not done yet.

Same error again as NatCigg reported:

- Loading & processing shores data.
-- Total segments:1213679, maximal segment lenght:35.2
- Loading & processing rivers data...
--- Total river segments: 39929; max river segment length 4.9
  Complete
- Updateing altitudes...
-- Converting water bodies to elevations map
--- Iceles and Lakes
--- Rivers
-- Calculating elevation modifications to bring water to 0 feet
   Using:OpenCL solver running on GPU: GeForce GTX 1050 Ti; computing units=6

         Grid|  Vertices| Time (s)|Iterations| Bandwidth GB/s
      256x256|     57620|      0.1|       162|      9.2
      512x512|    230367|      0.1|       154|     28.2
    1024x1024|    921183|      0.2|       264|     52.7
    2048x2048|   3683717|      1.2|       457|     71.3
    4096x4096|  14733439|      7.1|       771|     79.2

    Total optimization time 8.7 s
    Maximal correction  range max=6628.0 min=-84.0
    Maximal land modificationt to below 0 alt 1100
- Fixing ground types...  using sse4.2

I updated 1.9 with update_makeahmap.exe so I will go download 1.11 (get the zip file) and try a total clean install and see if it happens that way to.
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 16, 2017, 09:34:43 AM
No need to download, just set

 disable_sse=yes

To configuration file

Please let me know if it helps?

What OS are you using?
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 16, 2017, 09:45:55 AM
One more thing,

Can you please set solver_force_cpu=yes and see if it crash during calculations of elevation modification (note it would run much longer, I just need testing if it works )
Title: Re: MakeAHMap 1.11 Released
Post by: NatCigg on February 16, 2017, 11:14:58 AM
i could not find "disable_sse=yes"

when i ran 1.11 with "solver_force_cpu=yes"

the program quit at "- Fixing ground types...  using sse4.2"
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 16, 2017, 11:18:01 AM
Just add it to the config.ini

It isn't there by default
Title: Re: MakeAHMap 1.11 Released
Post by: NatCigg on February 16, 2017, 11:40:17 AM
 :O

i added "disable_sse=yes" and the program finished

- Loading Profile from config.ini
  map_size=512
  map_name=miter
  tile_set=europe
  disable_sse=yes
  dem=srtm3
  lat=45.15
  lon=-84.8
  scale=1.0
- Version: 1.11
- Latitude, longitude range and scale
    Lat:     41.442     48.858
    Lon:    -90.057    -79.543
  Scale:      1.000
- Loading ground type mapping europe.csv
- Loading GlobCover Data.
- Loading Digital Elevations Model data.
- Loading & processing shores data.
-- Total segments:903174, maximal segment lenght:40.140
- Loading & processing rivers data...
--- Total river segments: 1542; max river segment length 4.260
  Complete
- Updateing altitudes...
-- Converting water bodies to elevations map
--- Iceles and Lakes
--- Rivers
-- Calculating elevation modifications to bring water to 0 feet
   Using:OpenCL solver running on GPU: GeForce GTX 745; computing units=3

         Grid|  Vertices| Time (s)|Iterations| Bandwidth GB/s
      256x256|     44145|    0.062|       176|    5.881
      512x512|    176255|    0.141|       200|   13.500
    1024x1024|    704485|    0.703|       357|   17.613
    2048x2048|   2816894|    3.906|       569|   20.054
    4096x4096|  11265417|   20.375|       773|   20.795

    Total optimization time 25.188 s
    Maximal correction  range max=1823.000 min=0.000
    Maximal land modificationt to below 0 alt 564
- Fixing ground types... Done in 1.250 s
- Saving ground types: splattype.bmp... Done
- Saving elevation data .raw and .bmp... Done
-- Maximal altitude (for use with TE bmp import) is 2272 feet
- Generating clibboard map... Done


Completed

p.s. I had set "solver_force_cpu=no".

Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 16, 2017, 02:55:10 PM
In the config.ini I set:

disable_sse=yes
solver_force_cpu=yes

Program then ran.
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 16, 2017, 03:21:28 PM
Ok, until I find what causing the problem please use

disable_sse=yes

no need solver_force_cpu=yes

if I will not be able to find/reporduce it I'll just disable SSE support by default :( 

It slows down some heavy calculations and what is more important - lives me with lots of questions why I can't make the SSE stuff work  :( :( :(
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 16, 2017, 04:14:52 PM
Ok I need you to test two versions of the program:

(a) Remove the disable_sse=yes parameter
(b) Run makeahmap.exe make sure it crashes on the setup

Check if my assumption of the problem is correct:

Download: http://cppcms.com/files/makeahmap/debug/makeahmap_reporduce.exe

Put it to same directory as makeahmap.exe and run.

Bring the output of the program and see if it crashes:

I expect to see something like

- Fixing ground types...  using sse4.2 ------------------

         UNALIGNED STACK

---------------------------------------------

Now we test if the fix works:

Download: http://cppcms.com/files/makeahmap/debug/makeahmap_test_fix.exe

Test if it crashes or runs correctly
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 16, 2017, 04:59:59 PM
Okay will do later tonight and get back to you with the results.
Title: Re: MakeAHMap 1.11 Released
Post by: USRanger on February 16, 2017, 10:02:53 PM
Worked fine for me. :salute
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 17, 2017, 07:07:21 AM
Okay,

I removed the disable_sse=yes parameter and then ran makeahmap.exe, it crashed where you expected.

makeahmap_test_fix.exe  successfully runs the program and creates the expect output.
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 17, 2017, 07:17:10 AM
Okay,

I removed the disable_sse=yes parameter and then ran makeahmap.exe, it crashed where you expected.

makeahmap_test_fix.exe  successfully runs the program and creates the expect output.


Great, did the makeahmap_reproduce printed

UNALIGNED STACK?
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 17, 2017, 07:33:12 AM
Nope. Basically makemap gets to

- Fixing ground types...  using sse4.2 ------------------

and then crashes for me brining up a dialog saying it has stopped working. Debug or close program. I don't get any text saying unaligned stack.
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 17, 2017, 07:43:25 AM
OK thanks...

The "--------------"


Is the start of the unaligned message so it confirms what I suspected  :aok



So I'll release the official fix soon   :rock
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 17, 2017, 08:04:02 AM
So I went back and double check since I copy and pasted that line from your post.

In my CMD dialog I get the following when I try to build the default Israel coordinates:

- Latitude, longitude range and scale
    Lat:     27.542     34.958
    Lon:     29.433     38.107
  Scale:      1.000
- Loading ground type mapping mediterranean.csv
- Loading GlobCover Data.
- Loading Digital Elevations Model data.
- Loading & processing shores data.
-- Total segments:1453128, maximal segment lenght:70.704
- Loading & processing rivers data...
--- Total river segments: 8474; max river segment length 7.940
  Complete
- Updateing altitudes...
-- Converting water bodies to elevations map
--- Iceles and Lakes
--- Rivers
-- Calculating elevation modifications to bring water to 0 feet
   Using:OpenCL solver running on GPU: GeForce GTX 1050 Ti; computing units=6

         Grid|  Vertices| Time (s)|Iterations| Bandwidth GB/s
      256x256|     42102|    0.050|       213|    9.188
      512x512|    167949|    0.113|       351|   26.164
    1024x1024|    670887|    0.311|       454|   49.147
    2048x2048|   2681840|    1.612|       842|   69.365
    4096x4096|  10723228|    9.831|      1504|   80.425

    Total optimization time 11.918 s
    Maximal correction  range max=4887.000 min=-1368.000
    Maximal land modificationt to below 0 alt 499
- Fixing ground types...  using sse4.2
Title: Re: MakeAHMap 1.11 Released
Post by: artik on February 17, 2017, 08:05:59 AM
But test_fix version works?
Title: Re: MakeAHMap 1.11 Released
Post by: ghostdancer on February 17, 2017, 08:30:50 AM
Yep, test fix works fine and successfully generated all the files for the Israel coordinates.