First time I saw this idea was Berg's "Here and There" poster from 2009 (a year before Inception) though they acknowledge a bunch of earlier inspirations...

https://berglondon.com/blog/2009/05/04/here-there-influences...

That seems like enough prior art to invalidate much of what could conceivably be considered novel in the pending patent...

I once saw a patent on that already earlier somewhere, which i assumed was the reason none of the automotive navigation UI's where doing this.

Just checked again, and it's verbatim this use case and even active until 2030 still:

https://patents.google.com/patent/US20100305853A1/en

3-D map display

Abstract

A computer generated 3-dimensional map display includes a reference icon identifying an observation point in the geographic area defined by the map, the map being presented on a curved surface which extends from a first plane to a second plane which is substantially orthogonal to the first plane. The observation point is located in the first plane. The display is configured such that the height of landmarks and buildings in a defined foreground of the reference icon are presented normal to the first plane, the height of land marks and buildings at a defined far distance are presented normal to the second plane and the height of land marks and buildings in a defined middle ground are presented normal to the non-linear portion of the curved surface. The geographic area represented can be translated along the curved surface to provide a perception that the reference icon is roaming through the displayed geographic area.

By no other than "Here and There" Schulze and Webb Ltd later rebranded to BERG.

The generic use case of a multiperspective camera method for that was arguable covered in a 1997 Disney paper latest.

Multiperspective Panoramas for Cel Animation https://www.cs.princeton.edu/courses/archive/fall00/cs597b/p...

The patent application is not yet publically available, so I can't tell what aspects of the system they are trying to protect. They probably have some narrowly tailored features that they can protect. Maybe related to the rendering, or some toggle button feature of the display. But, as to the broad concept of a curved hybrid combination of street view and overhead view, I agree that they will not be able to protect that aspect.

Yep. First time I saw this idea was Animal Crossing: Wild Word's "rolling log" effect in 2005, albeit in reverse. (So you get a top-down view and a horizon view at the same time). Second time I saw this specific idea was a Minecraft vertex shader in 2013 with the "Acid Shaders" vertex transform shaders.

Was thinking the same thing- I still have those posters and was thinking of them when I saw this was patent pending.

For me it was Halo: Combat Evolved

Exactly what I thought of, I bought these posters at the time and they are still in the cardboard tube.

Great memory, great reference!

I remember working on something like this as early as 1999! It was for a small European company, sadly we weren't able to put it out due to licensing restrictions at the time.

This is a really good proof of concept. I would use this.

Something about the moment of the turn itself isn’t working for me though. Just before the turn you have essentially no information about the route ahead, until after the turn is completed. This would make a sequence of consecutive turns difficult to navigate.

I had similar thoughts, but this is a largely solved problem: even headlights in my Volvo turn as I turn the wheel, and it should be easy to change rendering direction to an "average" of road tangents for the next say 50m (would depend on the speed and would need experimenting to know the best value).

This is exactly why on traditional gps maps I prefer it to be very very zoomed out. It's far too common that mapping tools make something like a sudden second turn invisible to you until it is too late to switch lanes.

I find that Apple Maps is typically pretty smart with its automatic zoom. For a typical intersection with just one turn to navigate, it will zoom in to give you a good sense of the lanes, stop signs/lights, etc. But when there are consecutive turns to navigate, or a heavily curved section of road (like highway on-ramps) it will zoom out and even rotate the map to show that upcoming context.

Apple Maps got really good at some point! I once pick it by accident for navigation, and never went back to Google Maps.

It’s unusable in Sydney, Australia.

It might be fine for pure navigation to addresses but business addresses and other metadata are often missing or out of date because people only bother to update Google Maps. Also that’s where all the reviews are.

I don’t want to use two different apps for navigation vs finding businesses.

Since the last time I tried, Apple Maps has come down from plotting some 30 petrol stations in the Sydney CBD to 2. There are in fact none.

Apart from needing to copy and paste destination addresses from Google/Google Maps every time I use Apple Maps, it's great.

I've used it almost exclusively since around 2019, but that has been in the Bay Area and LA area where the data has presumably been very good relative to other areas.

I think it may depend on where you are.

Around here (Long Island, NY), it's far better than Google Maps, and I use it all the time.

I've heard that it falls down, in rural areas, though.

I uninstalled Google Maps when it started draining my iPhone battery at an absurd rate. Apple Maps it is.

I have had an occasional problem where a large building ends up blocking my view, but in general it’s very good.

I remember for at least a while people would complain about how GPS navigation ruined their sense of the local area. Probably stopped hearing about it because people have just surrendered to the apps, but I think part of the reason is also that by default they were just zoomed in way too close. If you forced them back out a ways, I was actually learning a lot about my local area. Like, there's all these subdivisions around, you know, and from the outside who knows what connects to what, I'm not going to just duck in to a subdivision and physically navigate the streets to see how they're all connected, but driving around with the navigation made it much more clear... when it was zoomed out somewhat.

Took me a while to figure out what you're saying, now I assume you're using the "up is direction of motion"?

I use map view / north is up, which makes it reasonably easy to get he big picture - I encourage everybody to try it :).

That seems very wrong and unintuitive for U-turns.

It does.

Let us embrace this minor imperfection by simply excluding U-turns from this presentation method.

So why not use 2D maps, have people lost the ability to read North up maps? I swear ever since paper maps have not been used in cars, people have gotten spatially dumber.

I love north-up maps because I find they give me way better spatial context. My truck’s nav system gives north-up as an option but my phone and my truck map both suffer from the same problem on different axes. My phone sits in its holder vertically, so I have way more north-south context than east-west. The truck screen is landscape, same problem north-south! A square map north-up would be amazing!

This looks pretty neat but also distracting and not very convenient. A useful follow mode should provide a view into the next several dozen seconds of road conditions. This projection forces road sections after sharp turns to go off screen, and does nothing to compensate for that (e.g. by rotating the view), so the distance and time of useful prediction changes constantly. Since you're already willing to give the driver nausea, consider unwrapping 90 degree turns into something more straight until they're close enough.

I think it'd be pretty easy to fix, too. Have a point on the line that represents "10 seconds from now" and orient your camera along the line between that and the point representation of your car, with slow, smooth panning so as not to get jerky transitions. If "10 seconds from now" is within a certain range of the car, it ought to just default to whatever its doing now.

I found it useful because it shows context for the next turn and information about the street network near the next turn

I agree and for me that weirdly felt more natural

It could possibly be less nausea-inducing and make the turns less jarring if the follow pespective was slightly elevated and not at ground level.

you might find it better in openstreetmap

https://x.com/rikarends/status/2093273761797554552

I feel like video game logic would be useful here where a view like this would replace the main view and the “macro view” would be a minimap in the corner.

I think where the actual distraction is comes from the level of detail. It would actually benefit from just having silhouettes or lower resolution “suggestions” of what’s there. It’s maybe just the buildings on the corners of turns or specific landmarks you’d want fully rendered so people could follow ambiguous directions like “Turn left at church, but not the Methodist church the Episcopal one!”

I see a whole new business category being born: Nausea as a Service!

Yes, I'm not normally prone to motion sickness, but the change of perspective during a turn is quite unpleasant.

Yeah it made me feel the instant onset of what I recognize from vast personal experience as motion sickness. I would never be able to use this.

Even aside from that, the constant feeling of going downhill would be off-putting to me.

Yea, I felt like I was perpetually at the top of a roller coaster and going over the hump, but never finding the bottom. And I like roller coasters. But no thanks. Not even sure what the benefits of this view really are.

It's already been done - VR

I have no problem with VR, but this demo was very disorienting. I can’t even imagine trying to look at this while driving.

b-AR-f Bags - half surgical mask half airplane sick bag

Im clicking "Apply to YC" right now

Nausea as a service, while begging for investments...

This is pure Bret-Victorian magic. Really the greatest single notational/visualization I have seen in a long long time. Wow. I'm so in love.

Great idea and demo. My main gripe when using Google Maps in the car is lack of information about the next turns — when do I change lanes, and to which one? This could be natively addressed here, especially if the blue navigation line was a little thinner and showed which lane(s) the driver needs to take.

This comment confuses me a bit because Google Maps (at least in the US, in my experience) is really great about telling you what lane to be in.

> Google Maps (at least in the US, in my experience) is really great about telling you what lane to be in.

Having recently driven in Boston[1], the problem is that Google Maps tells you what lane you need to be in when the route divergence happens... it doesn't tell you what lane you need to be in to get to that lane.

So I would see guidance like be in the first or second lane (from the left) to make this left turn and all seemed well since I was in the second lane from the left. Then two more lanes merged in from the left and I had to get over two lanes and ended up on a two mile onramp for the highway to New Hampshire.

I see the same things locally, but it's not as obviously bad because I'm familiar with the local highways and also most of the local highways aren't as space constrained so there's almost always plenty of time to merge.

[1] I don't recommend it... we should have driven to the airport and returned our car and taken transit back to our hotel

I need to know what lane I'll need to be in next so I can plan in advance.

Yeah, there’s a tendency not to know with sufficient time, especially with heavy traffic.

Not every road owner in the world has provided how many lanes a road has. To tell you which lane to stay in, it need to know how many there are!

Where in the world are these road owners, and do they really eve provide this kind of information to mapping companies?

Here in the States, most of the roads are "owned" by the people and our various thousands of governmental jurisdictions do not tell anyone about these kinds of details in any uniform way.

We just kind of figure it out on our own.

That's also where this map would help, it can definitely degrade gracefully. If I know I have two right-hand turns coming, I can take the decision for myself.

This information is all derived from overhead (satellite and aerial) imagery combined with street level imagery (like from Google street view). No road owners required.

It fails the task as often as not on large East Coast highways. Not nearly as bad on the West Coast.

This is cool. May I suggest that you make the standard deformation much less spherical? I do not get nauseous that easily and it made me a little nauseous, feeling like I was falling. I would not want to watch that while driving in a car. But 1/3 of the way from ‘flat’ to that would be super useful.

I'm with you on this. I think this could actually be really useful but the effect is way too extreme. Additionally, the animation is quite stuttery on turns --- might just be my machine though.

thanks. Yes, youre not the first one saying that. Next demo update will have more options

Same. I don't get motion sick, and this made me feel uneasy. It would make my wife motion sick instantly. It's an interesting concept though, and I can see the utility of it.

Agreed. I have no problem with a tilt a whirl but this triggers something.

Thanks for sharing! Building this in public, check my X for more updates! https://x.com/karshuit

I don't really know why, but the thought of my (elderly) mother using this made me laugh almost as hard as the El Risitas guy[1]. I adore it, and it also should never ever be used in any car GPS scenario. It's far too distracting, and puts far too much emphasis on the places you are not going.

I could see it being useful for a more exploratory style of map, however. Games like Pokemon Go come to mind as a place where this would be pretty cool.

[1]https://www.youtube.com/watch?v=Fkk9DI-8el4

> far too much emphasis on the places you are not going

I have this issue with literally every modern nav system. They all make their fundamental display a line marked on a map, and most of the information on that map is irrelevant.

More than 20 years ago I had some kind of Verizon flip-open phone with a QWERTY keyboard. No idea what model, but it had this fabulous nav interface that just showed big arrows showing your next two turns and a schematic diagram of what the next turn would look like. I wish I could get something like that, but with Google's data as the back end.

That's almost perfect.

Proposal: The use case is to inform the user of landmarks on the route before they need them, giving visual cues about the scenery.

It's missing an early distortion along the direction of the turn though, each turn feels jarring and drops the useful spatial awareness aspect.

I miss such a landmark feature in all available routing apps and think it will become standard in selfdriving cars where there is more possibility for the driver to look around the landscape

The concept is good, the implementation not so much, at least not on desktop. Mouselook doesn't make sense here; A and D should turn, not sidestep, which you can't do in a car. You do show a car right at the outset so people are going to imprint on that. Lack of arrow key support also alienates non-gamers.

This is surprisingly useful. As I was imagining myself behind thr wheel I felt it was more clear as to when/where the next turn is. Probably because it combines top down flat with 3d spatial vs just one or the other. This was really good. I want it.

Neat!

Not sure if this is meant to be practical, but I think this would work better if the upcoming turn was centered in the view once it’s within a certain range, as a kind of anticipation. This helps prepare for the jarring shift in perspective and, in case there’s multiple turns in short succession (as there might be when exiting a highway, for instance), gives you a visual heads-up about what’s next.

Patent Pending, In europe?

TIL Software Patents are still totally a thing in Europe via a back door.

I think this takes the record for top thing that I expected to be wildly unintuitive and turns it to be incredibly intuitive. I absolutely love this and want it for real. It gives me a road view and an aerial view and transitions smoothly. Needs polish and to somehow be accessible in seconds for everywhere but I would default settings this in my car if it was there.

Patent Pending?

Any patent attorneys here know what exactly about this is "patent-able"?

My understanding of the legal field is it's less about the actual law and more about how much you're willing to spend.

Maybe nothing here is patentable. We don't know yet.

All we know is that they've applied for a patent. If the patent they seek is granted, then it will be published and there will be no mystery about what it covers. :)

As a side effect, this is a neat way to visualize Gaussian splatting! As you go further away from the main navigation route, the quality of the rendering continuously degrades, until it eventually becomes sparse ellipsoids (i.e., you can see the individual splats).

Mine gets stuck at loading 90%.

The traffic right now is insane, 200 people trying the demo at the same time :\

Isn't it just static files? Use a cdn like cloudflare or AWS CloudFront or depending on size - if you can break it into chunks of like 50mb each, GitHub pages (free)

200 people or 100k people wouldn't matter then, it'll be cached.

It will also make the download based almost entirely on client download speed.

is 200 a lot of concurrent people? What is required from the server in order to render the demo, can't most of the work be pushed to the edge devices?

yeah I probably shouldnt have included a 100mb gaussian splat file to load each time.. I had no idea so many people would try it :)

Any video demo available - love to see it in action

Absolutely honest question: what is the advantage of this over a top view navigation with the orientation following the orientation of movement? Am I missing something?

If you've ever been confused about which turn is which with top down navigation, then this is for you. While driving a car, being able to at a glance know exactly what turn is what would have saved me countless wrong turns, my parents probably doubly so.

One classic: there's a fork in the road on the way to my parents. One side is "straight", the other side is an exit. I took the wrong, exit side of that several times while my app said to go straight before I just knew the route and didn't need GPS at all. Top-down isn't as good in these cases because of densely packed roads and back to back exits.

That said, it's "good enough" and I doubt this takes off.

while I think that the widgets telling you which lane to put yourself in largely solve this kind of intersection confusion, I understand the problem you are describing

but this seems to me just a topdown and "third person" at the same time through the distortion, I don't see how it helps with knowing exactly where to turn, is it because it shows the way further down the turn (like, sideways after the turn in the demo) ?

For me, confusion in top-down navigation happens either because there's no bitmapped imagery being displayed, forcing me to guess where the turn is by mentally wrapping vague 2D geometry over the scene viewed through my windshield, or because the trace isn't drawn precisely enough over the imagery that is available.

I don't see much added value with this particular nausea-inducing approach. It falls into the category of "You should've thought less about whether you could and more about whether you should."

You can calibrate navigation to visual landmarks, i.e. you can see the turn coming up and match it to what you see out your window. But you also still get an overhead "what lies ahead" map for planning your route further out. This is an interesting concept, maybe a hybrid approach would be useful, a simple overhead streets map as default that swaps to the 3rd person view when you approach your turn.

Gets stuck loading at 90% for me

Beautiful perspective if you need to take a left in 500 meters. Not so great if you have to take a left in 3 kilometers because that would just not be visible.

Now of course you could change the parameters so that the upper screen border is 3 kilometers. But normal standard perspective is even better, because it can show you up to infinity. The inherent concept here is that there is a cut-off at the top, and that there is always a lot of unnecessary stuff near you whizzing by to look at / dopamine kicks. So you would have to constantly look at the screen - instead of at the road.

Navigon (among others) back in 2009 showed a perspective that balanced between showing the next junction and the next few kilometers. And leaving out anything unnecessary. I like that better. Example: https://www.notebookcheck.com/fileadmin/_processed_/csm_Garm...

The trick would be adapting relatively, which a lot of apps already do... zoom/flatten out if it's a long stretch of nothing, back in when you start approaching more complicated sections.

I've been playing video games for decades and this made me sick to my stomach almost immediately, but neat otherwise

A problem of open GeoData is very much their coverage and availability in the EU. While the countries and their survey offices are required to release high value datasets in standardized form, some simply don’t. In Germany we have 16 states and every one of them has their own standard and pipelines for generating that data, and everyone releases it differently. Take LiDAR: Bavaria should be distributing it through OpenData portals and is required to by the EU, but they simply ignore that and charge 8000€ for it. Building international or even EU wide geo-projects from OpenData like https://hillsha.de is difficult because of that, you never get full coverage.

But as a tool for mapbuilders for small areas or planned tours i think this could be great

Neat!

It might be useful to be able to configure the map viewing angle at the top and bottom of the frame, perhaps even the degree of curvature between them.

I say this because I wonder if a shallower gradient (slightly more top-down at the bottom and slightly more angled at the top) would be more understandable and familiar while providing almost as much information. Not as cool-looking, but potentially more useful as a real navigation aid.

thanks. Im still tweaking the map and camera settings, its far from perfect yet. Maybe next demo update I'll include some of the sliders to play around with

This made me feel sick in 5 seconds.

Neat. Kinda novel. But sort of impractical and doesn't solve a problem anyone actually has with current navigation UIs. I still like it anyway.

Very cool, after watching a minute it grew on me and I can see why the perspective is useful.

My immediate thought is that this is what is would be like to drive in The Spindle in Neuromancer or any similar space environment that’s spinning for artificial gravity.

The top down view of upcoming traffic complications ahead of a forward angled view of your surroundings seems incredibly practical to me.

I'm fortunate to not suffer motion sickness in general, but I showed this to my wife for 5 seconds and she was feeling motion sick.

Personally, I love it. It's fun, and I look forward to using it one day in lieu of exclusively top down or forward angled alone nav tools.

looks cool.

But estimating distances is hard, as is estimating road size. You can only plan one straight line ahead, and there's no "glance how many blocks before I make a left turn". Now it's "scan and process the entire straight terrain section with eyes recognizing crossings to get the count" Alternatively, I'll have to task switch all the time to it to not miss on the turn. Some hybrid map visual overlay that makes reading it at a glance easier would go a long way here.

Also any points shown (e.g. destination, POIs) that are more than a few degrees away from straight ahead appear to be next to you, but following you which is quite confusing.

A variant of this but taking place on an O'Neill Cylinder would be amazing. I've always been captivated by the idea of the horizon curving up in front of you.

I almost immediately click-dragged into a nearby building by accident, and am fascinated by how this engine attempts to extrapolate the inside of the building using only information about the outside. It's kind of surreal, and slightly more convincing than it feels like it should be at times

Folded cities being primarily associated with Inception instead of ringworlds really shows you pr is everything.

It shows PR is mind rape.

In the demo, the "Destination" and "Point of Interest" seem to be floating around randomly. I'd expect them to point out the things they're labeling, but their movement seems to bear little correlation to anything.

Thanks for the Vertigo Rollercoaster

let's give drivers motion sickness isnt a good strategy, just my opinion.

I also experienced vertigo, but I'm particularly prone to vertigo induced by 3D scenes. Still, I think this is the first time a screen as small as my phone did it.

Nice work! This sort of reminds me of a game I saw demo'd on HN about a year ago, where you could walk and talk to the people and do some tasks- the difference being - in that game the world felt like a convex sphere and here it is concave.

Insanely cool. Good job!

Very cool. This would actually save me from those terrible times when the navigation tells me to turn, but not which lane is best for the next turn after that. Now I could visualize it clearly.

That being said, it is a little dizzying to watch.

At first I thought this was a cool gimmick, but this seems like it would be really helpful. You get to see the angle of the curve from the driver's perspective and the overhead view at the same time!

I think it could be useful in really dense exchange hubs when you don't clearly see which lane you have to take.

That was surprisingly nice. I get to see the far distance on the map. Something has to be done about turns, though. They’re far too whirly for me. Good demo!

Is this supposed to be usable at all on Firefox Android?

I'm getting a solid frame per second in FF android. It's quite nostalgic to have a navigation system this laggy.

It runs about as well in Chrome as in Firefox for me, so I don't think this will work particularly well on any phone at the moment.

I don't remember a map from the movie so I didn't know what to expect. Instantly I love this. I actually wish I could have this rather than street view in Google Maps.

Huh, patent pending? I am somewhat sure there is a mod for minecraft.

Nice. I'm loving seeing the increase in usage of Gaussian Splats these days.

And it's getting so much easier to create them too.

Sounds cool, but it's too heavy for my laptop.

This is insanely cool. Incredible.

Very cool but wow that just triggered motion sickness I didn't even know I had

this looks pretty cool. since it curves the the 3d map, what would it look like when you are driving through downtown highrises? would the tops of the buildings clash into each other?

what about steep uphill/downhill sections ?

Would love this for walking around nyc

Looks ok but easy to get lost literally into the weeds of the vegetation.

Navigation needs to be low cognitive overhead to have mass appeal. There's a reason why people do not navigate with satellite or photo real maps. This is an interesting projection and visualization but doesn't have much practical value.

This is great but also i want to vomit

gave me motion sickness in the turns, but i guess i should be looking at the real road

This would be an insane video game map.

This would be a fire FPS especially if the bullets traveled along the curve.

Even crazier idea would be the possibility of 'normal bullets' that travel along the curve, and 'special bullets' that travel on a direct diagonal via warped space & time.

This is pretty intuitive and useful, I think. I would suggest swapping to an angle equal to half the angle of the turn once your approach is within a certain distance, to show the user what is coming up around that turn. Frequently you need to turn then turn, so seeing 'ahead' a bit would be cool

Zero chance you can patent this though.

Spent 20 seconds on it.

Very cool idea. I was on board until the first turn, then I just felt seasick.

Does it come with barf bags, or at least a discount coupon?

Good luck with that patent.

ok this is nice

Bad ass. Nicely done.

Finally something new and shiny. Looks promising.

Cute. Only runs at about 1fps on my 5yo LG phone but it's a miracle it runs at all.

What problem does it solve tho ?

What the hell is "right drag"?

Hold down secondary mouse button, typically the right one, and move the mouse. (If you don't have a mouse attached, you might not be able to perform this action.)

It means click and hold the right mouse button, then move the mouse. Fair question, the label is pretty cryptic

J. Edgar Hoover

Why does it have to be an iPad mini? It's not even oled and there are hundreds of other small tablets available for less money.

...and they're promoting it by referencing said movies.

Adding two existing features together (gps mapping on an inverted sphere) doesn't seem to be the basis of a patent to the rules of incremental innovation.

Does anyone else hate how Google Maps zooms in right before a turn?

Yeah go ahead and completely change the scale of what I’m looking at a night quite predictable time just as I’m about to need the map the most to make a turn on a street I’m not familiar with

Absolutely fucking brilliant idea

This is why I use Apple Maps and thankfully in the Bay Area it’s more than at parity, it’s frankly better

All that said, this UI is actually awesome - just needs a little tweaking for the turn animation but I’d 100% use this - incredibly intuitive

Cool idea, but it feels more suited for pedestrians or cyclists moving at a slower pace. Not sure this format would work well in a car, since you can't really see the whole road ahead. At 100 km/h, you need to grasp the route and upcoming turns quickly and this view might not give you enough time to get in the right lane. Still, props to them for trying something new.