Pokémon Go leads the AR Revolution

Originally posted on xyHt Magazine 12/7/2016

 

Six months ago when I claimed that augmented reality was the future of GIS and geospatial services and it was met with a few sniggers. This week has seen the arrival of Pokémon Go, one of the most popular games hit the mobile phone market….and yes, it is augmented reality and yes, it is geospatial. It could well be the turning point for many geospatial companies.

pokemongo

What is Pokémon Go?

In case you have been hidden in a cave fro the last 25yrs, Pokémon is a game that first appeared on the Nintendo Gameboy (circa 1995) in which players openly walk around the world and capture mystical creatures (in a white and red ball) which they then train to fight (other creatures) in battle arenas called “gyms”. If their creature (called a Pokémon but there are hundreds of breeds) wins their battle, then they earn a badge. The aim is to collect all the badges. Simple right?

Since the mid 90’s there have been 18 manga books, 19 films and about 17 games….yes, this thing is HUGE. Pokémon Go is the new generation and it was inevitable that it would become a geocaching game.

“Geocaching /ˈˌkæʃɪŋ/ is an outdoor recreational activity, in which participants use a Global Positioning System (GPS) receiver or mobile device and other navigational techniques to hide and seek containers, called “geocaches” or “caches”, anywhere in the world.” – Wikipedia

Pokemon Encounter

Why Pokémonn Go is perfect for AR

Lets look at the concept of the game again, the user walks around the globe looking for Pokémon to capture and then train…..if this isn’t the definition of geocaching then I will eat my shorts (thanks Bart). Though any thoughts that this game was designed as a geocache promotion are quickly quelled when you realise that the first geocache was made around the millennium (by Dave Ulmer, Oregon).

For years we have struggled to get our children interested in mapping and geography not realising that this was sat under our nose the whole time! I ironically, it is all due to an Aprils Fools Day joke in 2014 in which it was claimed that Google had developed an augmented reality app…..Niantic saw that this could be a reality and worked with Google, the rest is history.

How does it work?

After logging into the app for the first time, the player creates their avatar. The player can choose the avatar’s style, hair, skin, and eye color, and can choose from a limited number of outfits. Once the avatar is created, it is displayed at the player’s current location along with a map of the player’s immediate surroundings. Features on the map may include a number of landmarks where Pokémon may be and Pokémon gyms (places where you battle your Pokémon).

As players travel the real world, the avatar moves along the game’s map. Different Pokémon live in different areas of the world; for example, water-type Pokémon are generally found near water. When a player encounters a Pokémon, they may view it either in augmented reality mode or with a pre-rendered background. AR mode uses the camera and gyroscope on the player’s mobile device to display an image of a Pokémon as though it were in the real world. Players can also take pictures, using an in-game camera, of the Pokémon that they encounter both with and without the AR mode activated.

There is a fantastic article on how Google chose the locations for the Pokémon/geocaches here (by Mashable) whereby it explains how safety was the primary concern. Caches were chosen based on open places that had some significance so that players wouldn’t be chasing a Pikachu (a type of Pokémon) across a train track.

Pokemon Batlle

Why will it change geo things?

Already there is a wave of companies looking at how they can use marketing to get a piece of the pie, see this & this, it is evident that people are aware that this is, excuse the pun, a game changer. It really isn’t hard to see that this is going to be popular….so this might well be the turning point for geospatial, AR & VR. If people are comfortable using AR through this game then they will start expecting it for their mapping, bringing back apps like LAYAR which augmented real world information.

AR on Mobile

The applications are immense and exciting for the geospatial industry, the ability to overlay real world issues and information to what the user sees through the camera would be the definitive mapping system. Even if the accuracy isn’t that amazing (mobile GPS – think about it) there is the potential to use clever imagery and presentation to overcome most issues. Imagine sending the worst member of your team to site, with an AR map you could be 90% sure that they would be able to find the correct building over using a 2D map, or think about how easy it could be to identify potential points of weakness or contamination around a site by just looking through your device, all set by someone sat at a desk on the other side of the world.

Of course this is speculation but consider the rise of VR which is now around us, soon we will all be fully immersed watching TV, playing games and riding roller coasters, 3D GIS has seen a rise over the last few years too, with many geospatial providers offering 3D add-ons or 3D alternatives. Furthermore the conferences were rife with talk and demonstration of 3D and VR. Of course all this innovation is led by CEOs and Project Managers who have seen their kid playing with some game and asking that all important question….

“Why can’t our company do that?”

You’d be a fool to think that this is all going to just disappear, the future of geospatial is now, we are seeing the evolution occur in front of our eyes – Just like the late Roger Tomlinson evolved the paper map to digital GIS in the 60’s, we are seeing 2D moving to 3D real world. I am all for it, it will bring new challenges, better accuracy and more interaction with the user…..though I draw the line at Pokemon Go myself.

Dragons8mycat

How to Grayscale ArcGIS Pro Vector Symbology

Most of the time, ESRI software is great, it does [mostly] what you ask it and as long as you aren’t doing anything too crazy it behaves. We all know that it has it’s ‘unique-ness’ about it, after using it for a few years you start to ask “why don’t they do this….” or “How comes I can’t do that…..”. Well, a lot of this is being addressed in ArcGIS Pro, already it has answered the question as to why we needed 3 different GIS software (ArcGIS Desktop, ArcScene & ArcGlobe) by bundling it all up into one package. Now (with 1.3) we are starting to see other features which we always wanted in ArcGIS Desktop coming into ArcGIS Pro, case in point, converting symbology to grayscale.

Today, I discovered while creating a basemap, that ESRI have implemented a couple of neat little touches, firstly RGB VALUES ON HOVER.

Hovering the mouse provides RGB values
Hovering the mouse provides RGB values

Although this isn’t ground breaking, it is a nice little touch which, for us cartophiles and OCD cartographers, provides a quick and easy bit of feedback.

The other discovery was having the option to grayscale the symbology. The new ArcGIS Pro can be a little tricky to get your head around, so it is understandibly not obvious but I went to change the RGB values on a piece of road and found another option: GRAYSCALE

Grayscale dropdown
Grayscale dropdown

Selecting “Grayscale” takes you to this menu:

Grayscale removes colour while retaining it's presence.
Grayscale removes colour while retaining it’s presence.

 

Okay, so this isn’t groundbreaking BUT having played with photoshop a little, I’ve found that the RGB value which is automatically given is almost a perfect match for what you get if you desaturate the colour.

What does all this mean? It means that you can easily and confidently convert your vector symbology to grayscale without guesswork! Creating alternative grayscale maps should now be a lot easier! Now, the question is, will this ever make it to ArcGIS Desktop?!

Dragons8mycat

Do your work right and you can be smart too

Originally published in xyHt

Ever since I saw the word phrase “smart city”, I have cringed. Not because of the term but what it alludes to. To me it says that we (geospatial experts) haven’t done our work right….let me explain

From Wikipedia:

“A smart city is an urban development vision to integrate multiple information and communication technology (ICT) solutions in a secure fashion to manage a city’s assets”

Now, my understanding, as a person who uses a GIS on a daily basis, was that a GIS was used to overlay and integrate multiple layers of information to gain insight and manage a project more efficiently….so, in reality, these two aren’t too dissimilar. In fact, when you look into it further, the [smart] platform is pretty much a GIS which links to live data and data which is structured to be interlinked [each data is linked to all the other data]…oh, of course, there is some form of asset management, usually in the form of a CMS [Content Management System].

Smart_City_GraphI guess my point is that I’m frustrated that many of us, geospatial experts, aren’t being “smart” with our data and hands up, at times I can be one of you. I download a load of data, put it in my geodatabase and don’t think twice about it until someone asks for it.

Here is a great example – I was working on site analysis of wind farms and pretty much the job involved loading in all the environmental constraints, physical and topographical constraints, overlaying them and finding gaps. The way it has been done for generations. Except I woke up one day and thought, “why am I doing this?”….and I looked at the data I was using and started to build a model (in ESRI modelbuilder) and what the model did was take all the files, spatial joined them (merging them with their attributes in tact) and then doing a few tasks to turn the gaps in the data into polygons. I then made a centroid from the polygons and THEN did another spatial join on the data using the nearby setting.

What I ended up with was a fully automated way to find the best sites for a wind farm and also report back (in spreadsheet) what the nearest constraints were. Over time I found there were other data I could build into it, like land use, Land Registry land type (freehold/leasehold) and even some analysis to provide slope, average sun, aspect. Yes, 3 years ago I was working “smart”….unfortunately too smart for the company as this new-fangled technology wasn’t as good as having somebody rummage through by hand to find the best locations (even though the best sites were the ones the computer picked!).

Let’s have a look at the principle behind this :

Knowing that we were trying to find areas suitable for wind farms, the area needs to be unbuilt land, have not within 250m of  a building, it shouldn’t be closer than 40km from an airport (though it could be), it shouldn’t be on anywhere too steep or next to an existing wind farm. Obviously it shouldn’t be in any of the environmentally sensitive areas.

Most of the data is open data –

Environmental constraints: Natural England

Wind farms: The Crown Estate and Restats

Land Registry land type: Land Registry

Land Use (rough):

Topography (buildings, terrain): Ordnance Survey vectormap, Strategi & Open Map

And (curiously enough) farms, restaurants, business parks and other points of interest were taken from my SatNav (extracted as a csv)

The model would then look a little like this:

WindFarm_Flowchart

But there are other ways to be smart

The former method uses a spatial join technique whereby features which lie in the same location are combined into a large dataset which can be interrogated. Another technique is to join tables of related information to enhance the data about location, this is quite commonly used in demographics but can be used anywhere.

A great example of this would be the neighbourhood statistics websites whereby they provide information about your locality…let’s have a look at how this can be done with openly available data:

If we download the Super Output Areas (average population approx 1000) from National Statistics, we can then join most of their data based on Super Output Area [SOA] ID

SOA_types
Output area types
ONS_Join
By joining the area code to the area code in the table we can extract informative data

As you can see, this can be used to create much more informative data, some software vendors might even call it “enriched” data and it is extremely easy to do.

….and then you realise that you can THEN spatially join this data to buildings, political boundaries, offices and all other types of data to extract SMART data about the locations.

My challenge to you today is to “enrich” the next data you use, if only for your own satisfaction, add some demographic data to it, add some wikipedia data to it, spatially join it with the INSPIRE Land Registry polygons (while you can)….go on, do it……that sense of satisfaction, THAT is why you do GIS.

 

Nick D

 

Geobusiness 2016…THE place to be

From xyHt magazine 30/5/2016 – Original Posted here

GeoBusiness 2016 – London

Wow! Just wow [ed. Translation to US-English “Wow!!”]. Last week I was at the UK ESRI annual conference with 3000+ people crammed into the tight QEII conference centre, this still didn’t prepare me for GeoBusiness this year. The same venue as last year but somehow they’ve crammed in a few more stands and it was BUSY!!

Here are some stats:

  • 200 exhibitors from 17 Countries
  • 24 conference presentations
  • 85 workshop sessions

….and this was over just 2 days!

From the moment I got there at 9am until I got thrown out at about 4:30pm, I didn’t stop, as soon as one conversation finished, another began…such a great mix of Chartered Survey, Chartered Geography, Geomatics, GIS, Engineering covering all areas of geospatial work, it was hard not to be impressed.

GeoBusiness 2016 was held May 24th-25th at the Business Designn Center - Islington, London

GeoBusiness 2016 was held May 24th-25th at the Business Design Center – Islington, London

Ordnance Survey

One of the first companies I met was my old friends, Ordnance Survey. The headline “The most accurate and up-to-date geographic data now available for the first time in new application suitable for BIM projects” blazened across the page in front of me.

For a while I’ve been in contact with Ordnance Survey and been told many times that there was no interest in 3D (even though I’d worked on some in my employ there)….so it was a bit of a shock to hear that OS had been working with Cadline behind the scenes to produce a great new tool for Infraworks, called OS Model Builder.

Using the OS Model Builder you can rapidly create 2D and 3D building or infrastructure models which are BIM ready.

Gary McDonald, OS Strategic Relationship Manager said: “OS listened to feedback from the building industry and the result is Model Builder, a leap forward in bringing our world-class data under one roof and removing previous license hassles. We are also aware that when you are dealing with multi-million pound projects and making important decisions, you don’t want the risk of relying on inferior and inaccurate geographic data. You want the best and most current picture to work from.”

Ordnance Survey of the UK booth

Ordnance Survey of the UK booth

Avenza Systems Inc.

Next up I meet with Avenza, a leading developer of cartographic software, such as MAPublisher and Geographic Imager tools for [Adobe] Photoshop. as we chat about how cartography is changing, I hear that their mobile app has had over 1 MILLION downloads…..let’s just think about that, there are either a lot of kids thinking that this is a cool game or there are people out there actually using maps, Avenza maps to be more precise.

Avenza says that unlike other map apps that provide one view of a location using GPS coordinates, Avenzas PDF maps app provides a meaningful interface to measure distances, drop placemarks and share personal recorded data in various formats for use on land, sea or air. PDF maps is an award winning all encompassing solution for the use, distribution and sale of digital versions of paper maps to mobile devices.

My personal opinion is that it is a great app to use when travelling abroad as the maps can be accesses and used offline, removing the worry on international trips of that “International roaming” charge!

In other news, I noted that Mapublisher 9.7 was also announced with WMS now available to be managed, geopackage format now supported and the help system has been moved online…..

Avenza have been extremely busy these last 12 months!

VUCITY

I’m walking away from the talk with Avenza and I can’t help but be drawn towards a HUGE interactive table, this thing has to be 60 inches if not bigger and the images on it are crisp…..it is even harder not to believe that the city which I am moving around is an 3D model….it is so cool, it has shadows, real time sun position, atmospheric density….and that is before I point out that this is accurate to 15cm over the 130 square kilometres of London, it is expanding at a rate of 5-8 square kilometres a MONTH!

VUCITY Demonstration

VUCITY Demonstration

Sandor Petroczi, Product Manager of Vertex Modelling said: “Using a combination of photogrammetry, high res  aerial imagery and a highly skilled workforce, we are able to create our 3D model of London that can be used by any entity involved in design and planning of the city. We do not use any automated processes and although this is more expensive and time consuming, it allows us to create highly usable models with a consistent level of accuracy across the dataset. The team is currently capturing Camden and Southwark while updating existing areas from the latest 2015 imagery. VUCITY is an ideal solution for visualising the entire dataset.”

I’ve got to admit that I am very impressed but part of me is a little unsure about their claim to be the “first ever interactive 3D model of London” purely because I’ve seen a few 3D interactive models of London, one from CartoConsult, a company based in Swindon and also Garsdale Design (yes the one I work for!) although our model wasn’t served as a webGL to be interactive, it still won and ESRI award and I would suggest that it is a little better than 15cm, more like 4-8cm.

 

3D Laser Mapping

Walking away from VUCITY feeling very confused, I feel my phone buzz and I check my Twitter….and it’s Charlie Whyman from 3D Laser Mapping, asking if I’d been to their stand and I’d been REALLY impressed if I had.

Not one to shy away from a challenge I rock up, ready to rubbish such claims…but firstly Charlie is a girl and secondly their kit is pretty cool. Now, I don’t want that previous statement to come across as sexist, what I mean by it is that you come across a lot of men when you talk survey kit…A LOT of men, so having spoken on the internet with Charlie a bit, I had already put an image in my head….but no, not hairy, not wearing a hard hat, not even a pair of wellies….

Charlie of 3D laser Mapping and the backpack mobile mapping system

Charlie of 3D laser Mapping and the backpack mobile mapping system

ANYHOW, on display was a backpack type laser scanning system named ROBIN. about 8-10kg in weight and mobile enough to wear for a couple of hours at a time. I’m told that the portable battery pack would last you 3hrs (but is expandable). So that I can get an idea of HOW portable it is, I ask my human guinea pig, Tim Hughes, to put it on and see how it feels. Apart from looking like an extra from the Ghostbuster movies, it is extremely comfy and also it has a field of view of 330° and an 18MP camera. Best of all?….It is designed for outdoor and INDOOR capture, yes INDOOR (why I’m saying that in capitals, I don’t know).

At this moment, the ROBIN is waiting for the SLAM upgrade, which should be happening a little later in the year.

Mark Hudson of Geoterra said “Geoterra is very excited about the launch of the new ROBIN multiplatform mapping system. It’s become evident that there’s a gap in the sector for this kind of product and we’re sure it’ll prove to be an extremely popular addition to the marketplace”

The ROBIN mobile mapping system

The ROBIN mobile mapping system

So, to understand how the accuracy of the SLAM unit works (for indoor mapping) I went over to GeoSLAM to see if they’d talk….about all I got was a surveyor telling me how clever this device is and that it records you start point to high accuracy (typically 3cm but 1cm has been reported), once your position (indoors) is known, it then uses your route (provided you complete a circuit) to fully map the internals…..I asked questions about how it knows scale, units of measure, speed etc but was quickly faced with a blank face and the term “Really clever algorithms” – me thinks it is the beginning of a GREAT article for a future issue!

GEOSlam

As I said above, having been wowed by the ROBIN system, I went over to GeoSLAM to find out more about how the SLAM works but what I didn’t say was they had a huge screen up behind themselves showing the rather clean and crisp scan they had made of the exhibition center. Any doubts I had were quickly extinguished the indoor detail looked really good, with a 100hz sensor  and capture of 43,200 points per second, I’m not surprised.

The model I was being showed was the ZEB-REVO, a handheld laser scanner which automatically revolves compared to ZEB1 which was, errr….”interesting” to use. An unrelated demo video of the ZEB-REVO in action can be watched here.

GeoSLAM's booth - their ZEB-REVO handheld scanner-mapping system was out and about on the exhibition floor on demo duty...

GeoSLAM’s booth – their ZEB-REVO handheld scanner-mapping system was out and about on the exhibition floor on demo duty…

Graham Hunter, Managing Director of GeoSLAM said “The ZEB-REVO fulfills a new niche in the market for ultra mobile indoor mapping solutions. Our early adopters have been thoroughly impressed with the ease of operation, vastly reduced  scan time and accuracy of the resultant point cloud, all from surveying just 1 closed loop. It won’t be long until the ZEB-REVO is the ‘go-to’ standard in the surveyor’s toolkit”

Severn Partnership

Just around th corner from GEOSlam, I bumped into a Ben McEwen from Seeable, also Severn Partnership. I couldn’t help be be drawn into talking about the VR Occulus Rift on the table….Severn Partnership are a survey company, they have some great pieces of kit, their main man, Rollo was showing me over their road kit (mounted on a truck) and it is impressive, they are all chartered surveyors and know their stuff, all except for Ben….there was all this amazing 3D vector buildings (also in VR) and Ben was telling me how easy it was. Here is the real story, Ben is from a GAMING background, he is used to modelling games and adding real physics using the unreal engine…no wonder the models looked so good but it goes to show that sometimes we are too hung up on the detail and the accuracy….when we are looking at a visualisation, how important is it that it is 1cm-5cm accurate when you can emulate real world physics?….Watch this space….

Severn Partnership's "Seeable" visualisation tools were demonstrated on a VR Occulus Rift headeset

Severn Partnership’s “Seeable” visualisation tools were demonstrated on a VR Occulus Rift headeset

Several mobile mapping systems were parked in an outdoor area. Severn Partnership's Rollo Rigby (left-center) brought along their mapping rig featuring a Leica Pegasus:Two

Several mobile mapping systems were parked in an outdoor area. Severn Partnership’s Rollo Rigby (left-center) brought along their mapping rig featuring a Leica Pegasus:Two

British Geological Survey

A couple of booths up from Severn Partnerships was the BGS, what I wasn’t expecting to see was a 3D mouse sat on the desk….why? BGS are now providing 3D geology data for almost all of the UK. How cool is that? Okay, so it is high level, you can obtain 1:10000 scale 3D data for a cost but for many cases, this is great news.

PointFUSE

I bumped into these guys while gawping at a video of some mesh (point cloud) data being converted in one simple step into a vector polygon, no tricks, no messing with triangles, just a point and click conversion. Although currently (here in the UK) we are only able to access to version 1.2, look out for version 2.0 which takes things to a whole new level!

Point Fuse demonstrated their applications for converting point clouds to vector data

Point Fuse demonstrated their applications for converting point clouds to vector data

Also…

There were so many other great companies there, Leica, Trimble, TopCon and others but I see that I am already running close to 2000 words. In my opinion, the big conversation was 3D, everyone was selling it (albeit in different formats) and also good old fashioned surveying but using the new tools to make it more accurate and useable than ever before.

What a great event, let’d do it again next year!!

Nick D

 

More Photos…

Korec Group brought their mobile mapping buggy sporting a Trimble MX2 system. Parked behind that is a van with a Trimble MX8

Korec Group brought their mobile mapping buggy sporting a Trimble MX2 system. Parked behind that is a van with a Trimble MX8

Topcon's Sirius fixed-wing UAS

Topcon’s Sirius fixed-wing UAS

Topson's Falcon 8 multi-rotor UAS

Topson’s Falcon 8 multi-rotor UAS

– See more at: http://www.xyht.com/spatial-itgis/geobusiness-2016-london/#sthash.zeIhAsXG.dpuf

GISWorx 2016

Previously posted in xyHt April 2016

For most, work is a 9 to 5 grind that slowly eats at your core until you retire, find you have nothing to do and get bored…Not if you work in the geospatial field though, everyday is a new adventure and this month took me to the UAE, to be specific, Dubai for the GISWORX 2016 conference which is hosted by GISTEC.

IMAGE 1

Any thoughts of rocking up and spurting out some rubbish about topology and geometry were quickly quenched when I looked through the program of events which entailed subjects like ‘3D For Everyone’, ‘Geocortex Day’ and a rather awesome technical session on ‘3D GIS’ (held by myself) – full agenda here. In fact from the moment the plenary started, there was a theme, and that was how to use 3D integration.

Having been to many ESRI User Conferen

ces in the past, they mostly involve Story Maps, ArcGIS Online and getting you moneys worth from your ArcGIS Desktop, so this was a whole new world…as I walked around the stands I was talking with Dubai Municipality about “z mapping”, with Abu Dhabi Spatial Data Infrastructure on standards for heighted data and Barco on immersive envrionments, it was clear that I was amongst experts who already had control of their data and were ahead of the mainstream GIS which is current in the UK & US governments at present.

IMAGE 2

Once of my favourite talks and a favourite by many who I spoke with was “Changing the system: Happiness first” by CEO of GISTEC, Mohamed Abuziad. The talk was primarily 10 minutes of the GISTEC team in photos, but in every photo they were happy, they were happy to be giving you a solution to your problem, they were happy to be doing GIS, they were happy to be helping their country…..if you ever get to see any of this talk, it will no doubt make you happy! It will also make you wonder why why look to the money hungry corporations which we have come to rely on.

Another clear winner was a talk by Geocortex which started with a great slide:

“Whoever thinks money doesn’t buy happiness, send it over to my bank account”

…this guy could sell the clothes off your back and you wouldn’t know it!

IMAGE 3

The technical sessions had many hands on sessions which gave training on CityEngine, Story Maps and other areas of ESRI software…each one was exceptionally well taught with enough (trained) staff on hand to give guidance to those not quick enough to keep up. I had the privilidge of sitting in on my colleague, Elliot Hartleys workshop on CityEngine and GISTEC had not only supplied laptops for everyone, all preloaded with Windows 10 and CityEngine but also with some demo data – something unheard of here in a UK workshop (and the training was fantastic!)

While there, I was told by a few of the delegates I met that it was a little quieter than some years and even though it was an ESRI conference, there was little obvious presence of ESRI (except that everyone was using their software). I personally didn’t feel it and being so busy taking in all the information it felt like a great mix of people, with just enough room to stop and chat when needed.

It isn’t hard to see why the spatial infrastructure and methods for delivery are so advanced, just looking around Dubai (during the free day I had), you could see development occurring all around. There were (potentially) as many construction sites as there were built structures all meticulously planned and each one a work of art in its own right.

 

IMAGE 4

IMAGE 5

 

One thing I was glad that I saw, was seeing some of the clever “wind towers” (which were the theme of the EGI awards) – These are towers, designed to face the prevailing wind and allow air to flow through the building. This not only creates an airflow but also helps the heat escape making for a more habitable structure.

To wrap up, would I go again? Yes! Was it worth it? Definitely! A great showcase of dynamic urban planning and development which I would recommend to anyone in the geospatial field, if only to be inspired.

 

Nick D

GIS Tips – Quickly Scroll Through ArcMap Icons

Little trick to save yourself hours of trawling through point icons when using ArcMap (all versions)

It’s been a while since I posted a “GIS Tip” but this is a goody, especially if you spend HOURS scrolling through the ArcMap icons looking for that symbol which you thought was in one place but it seems to have moved…..

 

  1. Select the point icon you want to replace with a new icon and go to “edit”
Click on "edit"
Click on “edit”

2. You should then be presented with the following screen:

Point Icon selection screen
Point Icon selection screen

 

3. Now for the fun part…..scroll your mouse wheel up and down. Nothing right?….

    HOVER YOUR MOUSE OVER THE FONT SELECTION BOX AND SCROLL YOUR MOUSE

Like magic, you can scroll through the icons
Like magic, you can scroll through the icons

4. With your mouse hovered over the font box, you are able to scroll through the available fonts but ALSO it shows the relevant icons in the box below, enabling you to go through                 hundreds of icons quickly. Far better than individually going through each set of fonts in the search for the icon you are after.

 

There you go….you experts might already know it, but you new kids are going to love it!

 

Dragons8mycat

QGIS 2.14 v ArcGIS 10.4

Posted in xyht magazine 21st March 2016
This post almost didn’t happen, for over 7yrs I’ve been comparing GIS software in the hope that someone would be reading and take it upon themselves to fix a few of the issues which we all run into on a daily basis. With the new releases someone told me something and it almost stopped it all from happening…..

 

“ESRI is the Apple Inc and QGIS is the Google…”

 

As painful as it is to hear, it’s true. Even though I’ve been a hardcore user of QGIS for over 5yrs, I find myself falling back into using the ArcMap tools just to save myself rummaging through lists of plugins and I especially like that I can just drag and drop my data into the data frame and it just works.

As powerful as ArcMap/Arcscene/ArcGIS Pro/ArcGlobe/ArcGIS Explorer/ArcServer/Arc*add your own term here* is, it feels old and a little clunky, like using Windows XP. For a decade it has had the same comfy interface, the same basic functions and the same symbology. This is by no means a bad thing but the cartographic capabilities of QGIS are far superior and let’s not mention the true 64bit processing…

This year, there is a new contender from ESRI which I feel I need to discuss, ArcGIS Pro 1.2. Although it is in beta,  it is already proving itself a worthy successor to ArcMap. Unfortunately, until it is out of beta, I won’t be testing it as I feel it is unfair to compare an unfinished software/

Before we get to the crux of things, I’d just like to add that there have been no major interface changes to either software and I am GIS neutral. I just want a GIS that works and is reliable, I have no bias as to one or the other.

 

Let battle ommence
Let battle ommence

So what is new in QGIS 2.14?

The most talked about is the inclusion of a 2.5D renderer (covered in earlier blogs) but what you may not have noticed are the subtle changes, changes to the processing, caching, labelling and legend. Here is a full list which links to the QGIS changelog

 

What’s new in ArcMap 10.4?

There are quite a few new raster types available for the software, some of which I have to admit that I had never heard of but interesting to see that you can now export topology errors in the ArcMap Basic license. For those wondering why I haven’t listed all the changes, please remember that this is a comparison of the basic GIS software.

 

Data Management toolbox

New tools

Changes

Tool Changes
Add Rasters To Mosaic Dataset Two new parameters added:
Alter Mosaic Dataset Schema The raster_type_names parameter has 12 new options:
Analyze Control Points The out_overlap_table parameter is now Optional.
Apply Block Adjustment New parameter added: DEM.
Compute Control Points Three new parameters added:

  • area_of_interest
  • distribution
  • density
Compute Tie Points Two new parameters added:

  • distribution
  • density
Copy Raster Two new parameters added:

  • transform
  • format
Create Database Connection The database_platform parameter has a new option: DAMENG.
Create Database User When the tool is run against a geodatabase in Oracle or PostgreSQL, it now creates shared log file tables for the user. With the log file tables already created, the database administrator can remove privileges to create tables from the user, if needed, without negatively affecting the user’s ability to create large selection sets, edit data, or reconcile versioned data.
Create Enterprise Geodatabase When you run the tool on an Oracle 12c database, the sde user is granted privileges required to import data using Oracle Data Pump. This allows you to complete your Oracle Data Pump export and import workflows without having to separately grant these privileges.
Create Feature Class The geometry_type parameter has a new option: MULTIPATCH.
Create LAS Dataset New parameter added: create_las_prj.
Create Map Tile Package New parameter added: extent.
Create Mosaic Dataset The product_definition parameter has nine new options:
Create Pansharpened Raster Dataset The sensor parameter has seven new options:
Detect Feature Changes New parameter added: compare_line_direction.
Export Topology Errors You can now run this tool with an ArcGIS for Desktop Basic license.
Feature Compare The ignore_options parameter has a new option: IGNORE_FIELDALIAS.
Generate Tile Cache Tiling Scheme The tile_format parameter has a new option: LERC.
Project New parameter added: vertical.
Register Raster The transformation_type parameter has a new option: POLYSIMILARITY.
Synchronize Mosaic Dataset New parameter added: estimate_statistics.
Table Compare The ignore_options parameter has a new option: IGNORE_FIELDALIAS.
Warp The transformation_type parameter has a new option: POLYSIMILARITY.
Warp From File The transformation_type parameter has a new option: POLYSIMILARITY.

Editing toolbox

New tools

Multidimension toolbox

New tools

Python and ArcPy

ArcGIS 10.4 has been upgraded to include Python 2.7.10. Additional third-party libraries including SciPy, pandas, Sympy, and nose have been included, and existing third-party libraries including NumPy and matplotlib have been upgraded to more current releases.

The GetPackageInfo function has been added to return a dictionary about packages.

Editing

The topology edit tool now supports additional commands and keyboard shortcuts for selecting and moving nodes and edges.

  • Press the N key to select topology nodes.
  • Press the E key to select topology edges.
  • Move and Move To commands are now available on the topology edit tool context menu.

Parcel Editing

Parcel merge

The parcel Merge dialog box now has additional options for managing parent parcels. Parent parcels can be deleted, flagged as historic, or remain as current, active parcels.

Parcel division

When dividing parcels into equal areas, the number of parts on the Parcel Division dialog box can be set to 1. Set the number of equal area parts to 1 when a deed calls for a specific area to be divided from the parcel, leaving a remainder parcel.

Mean points

Performance improvements have been made to the Mean Points tool. Furthermore, the tool now always stays active and can be used repeatedly without the need to specify a tolerance.

Least-squares adjustment

Collinear line sequences in the same plan are straightened during adjustment postprocessing if they lie within the specifiedStraighten Collinear Line Sequences tolerances. These tolerances are available on the Adjust Coordinates dialog box.

Geodata

Geodatabases and databases

  • A new advanced option—All records for Tables—has been added to the Create Replica wizard. Checking this option allows you to designate the inclusion of all data from all tables in your replica. In earlier releases, you had to set the option to include data for each table individually.
  • Beginning with ArcGIS 10.4, you must set an additional option (Return Output Parameters As ResultSet) when youconfigure the ODBC driver to connect to Teradata.
  • ArcGIS now supports connections to Dameng databases. You can connect to view and analyze data in ArcMap. You can also publish map and feature services to ArcGIS for Server.
  • If you use SAP HANA 1.0 SPS10, you can now use ArcGIS to load data that contains z and m values and you can view and analyze existing data that contains z and m values.

LAS Dataset

  • There is a new scrollable LAS point profile view. Using the mouse/keyboard keys the area-of-interest profile window will move or rotate and update immediately in the profile window.
  • Location of the cursor in point profile window is displayed in ArcMap inside the profile area-of-interest.
  • Elevation is now displayed and updated when moving cursor around in point profile window

Raster

There have been five improvements for raster types.

  • The SPOT-7 raster type is now supported.
  • The UAV/UAS raster type is now supported.
  • The WorldView-3 raster type now supports the SWIR bands.
  • Support netCDF and HDF data stored as irregularly spaced arrays is now supported.
  • There have also been improvements within Chinese raster types.

There are several improvements with raster geoprocessing.

The Georeferencing toolbar now has three new first-order transformations available: Only rotation and shift, Only shift and scale, Only rotation and scale.

 

 

Testing

A lot has changed since I last ran this, I no longer have the 8 core 32GB RAM “beast” anymore for starters. I expect that times will be changed but by how much?

For those who want the spec of the machine I am using: System Spec

Although it is more home computer spec, I am reliably told that this is should be more than adequate for running ArcMap & QGIS.

 

QGIS_LoadTimetesting

 

1. Load Time

As this is a comparison of the 2 new updates, rather that witter on about my personal views, I thought it better to provide some test results. To make the test equal, the method I use was to start up the software being tested, leave it for 10 minutes (to ensure all elements have loaded) and the add ALL 2010 AIS from a folder in the root – C:GIS. If you wish to test the data yourself, it can be downloaded from here. The timer was started from the moment that the data is added to the data frame (through the add data button). The timer is stopped when all data has finished loaded, indicated in ArcGIS by the globe in the bottom right not spinning and in QGIS by watching the windows processes & seeing when the CPU demand dropped to zero again.

For those who wish to go further down the rabbit hole, I categorised the data for both QGIS and ArcGIS and saved the styles. The AIS was categorised using standard deviation (n0) with 8 categories. Data was loaded directly from the qml/lyr.

The time given is the average of the 5 runs which were made.

Results:

ArcGIS 10.2  =     27.27 seconds

ArcGIS 10.3  =     38.5 seconds

ArcGIS 10.4  =    24.04 seconds

QGIS 2.6 =     9.103 seconds

QGIS 2.8 =     8.201 seconds

QGIS 2.14 =   5.08 seconds

On average QGIS was 20 seconds faster to load the data, furthermore, there was a slight speed increase for QGIS from 2.8 to the newer 2.14

ArcGIS_AnalysisTest

2. Testing – Analysis

What use is your software if you spend your days waiting for it to finish a process? The amount of time I must have lost due to running processes is immense, so what if I could save some time? Because of this, I run a  a viewshed test. I put a single point down, Then, using standard settings (and OS Terrain50), I run a viewshed (ensuring the output raster resolutions are identical)

ArcGIS 10.2 =         42 minutes

ArcGIS 10.3 =         4 failed attempts & gave up*

ArcGIS 10.4 =         12m 55s

QGIS 2.6 =         58 minutes

QGIS 2.8 =     1hr 16min

QGIS 2.14 =   26.86s

It looks like either this machine is far superior to the old desktop OR both software has made significant improvements in its calculation algorithms. To confirm, both outputs were identical and can be obtained through the link at the end of the article.

*To eradicate any issues with the data input or user error, the ArcGIS 10.2 map was saved and then opened in 10.3, the exact same parameters were used with no success.

5. Testing – Map Export

I seem to lose days exporting PDF files from GIS, so for me, this test is one of the most relevant, so that I can compare the amount of time consumed by the simple “PDF Export”.

For this test, the same EFH shapefiles used previously were loaded, no styles applied, then the bathymetric contours (also from the Marine Cadastre website) and the ESRI world countries shapefile. I then opened the layout/composer & set the orientation to landscape & the size to A3. Scale was set to 1:50000,000 then centered on the EFH data.

Once loaded and left to settle of 10mins, I set the PDF export to 500dpi and then made sure that both the QGIS & ArcGIS settings were the same* (no layers, no georeferencing etc). This is the average times for 5 runs.

The results were as follows:

ArcGIS 10.2 =         3mins 18s – File size 795MB

ArcGIS 10.3 =        3mins 30s – File size 903MB

ArcGIS 10.4 =      7.04s – File size 1.9MB

QGIS 2.6 =         37.4s – File size 72MB

QGIS 2.8 =         35.5s – File size 69MB

QGIS 2.14 =      10.3s – File size 18.16MB

*Just to be clear, ArcGIS and QGIS were run separately

6. Stability

This is a new category, as a few comments I have had asked how many crashes I have had whilst testing. I am please to say on this occasion NONE.

6. Niggles

As I worked through, I must say that both software were pretty much as expected, nothing has really changed. The ONLY thing I would pick up on is that QGIS needs to add layers to their browser. When looking for data, QML & SLD are not visible in their relative folders.
The winner is....
The winner is….

7. Conclusion

As well as comparing the times above, I also run through both software by opening a list of tools which are used within the office on a regular basis to ensure that the software is safe to be used.

As stated previously, it would be unfair to compare the tools as some tools are unique or paid for plugins. Needless to say, I found no issues in my testing.

In this comparison, I think that, although ArcGIS 10.3 has released a HUGE number of new tools and updates, they are, in large for specialists. These tools are unlikely to get used on a regular basis like you & I.

QGIS has shown some muscle and has, in this testing, shown itsef much faster. Furthermore one of my “niggles” from the last article has been dealt with, the shadows for points and fonts. Although there are only a handful of updates & new features, the tools (for me) are more likely to be used.

Again, as before, there is no clear winner as they are both great systems and suited to different professionals in different way. For basic use or an introduction to the world of GIS, you wouldn’t go wrong whichever you choose.