Most active commenters
  • afavour(3)

←back to thread

303 points vyrotek | 58 comments | | HN request time: 0.456s | source | bottom
1. judah ◴[] No.45894501[source]
This is interesting for sure. Kudos for bringing this capability to the web!

One issue the demos reveal is, it doesn't _feel_ like the web. That is, I can't hit Ctrl+F to find text on a page. I can't select text with my cursor. I can't copy the address of a hyperlink. On my phone, I can't hard press on an image and share it to others. Screen readers can't handle it. I can't press a shortcut key to make everything larger.

These all may seem pedantic, but they contribute to the feeling "this is not the real web."

This is the same problem with Java applets in the late '90s, Flash and Silverlight in the early 2000s. They are islands of richness within a web page, but those islands are, well, opaque to browsers, search engines, and virtually all web tooling.

replies(14): >>45894544 #>>45894696 #>>45894702 #>>45894958 #>>45895158 #>>45895191 #>>45896100 #>>45896594 #>>45896771 #>>45897067 #>>45897513 #>>45899135 #>>45899880 #>>45902162 #
2. taftster ◴[] No.45894544[source]
That's not pedantic at all! Indeed, without these capabilities, it is by some definition not the real web.

This hits into that concept of what exactly the "web" is. Is it just a media transport system? Or is it something more than that. Of course, we could cite Tim Berners-Lee here or Roy Fielding in this discussion.

But at minimum, I think a lot of us are tired of the app-lification of the web and somewhat wish we could have a bit of the old.

replies(3): >>45895172 #>>45895323 #>>45899708 #
3. mhitza ◴[] No.45894696[source]
I think it's the same problem that flutter web has, and probably any other canvas/wasm based backend? Those features still need to be implemented, while still missing out on accessibility?
4. a2128 ◴[] No.45894702[source]
Not using the standard web stuff usually means it's also an accessibility nightmare, tried using a screen reader on the demo and it doesn't work at all unfortunately
replies(3): >>45894824 #>>45895986 #>>45898737 #
5. afavour ◴[] No.45894824[source]
I wonder if at any point browsers will offer a low level accessibility API for you to manually describe components. I’ve worked in the web for years and I’m a big believer but it’s also indisputable that Canvas offers more performant UI rendering than HTML when done correctly. I don’t think it should ever be used for web “documents” but web apps already bastardize HTML and CSS to achieve their aims anyway. Accessibility remains the missing component.
replies(2): >>45894964 #>>45897825 #
6. BoorishBears ◴[] No.45894958[source]
Am I losing it or am I looking ClearType on OSX?!

I get the value in this and realize it's not for your polished -$500 ARPU consumer social apps, but man this is weird.

(Also if anyone who worked on it is here, it's crashing for me on OSX 26, Chrome 142.0.7444.135, if I run an animation and hit back as the animation finishes)

7. shakna ◴[] No.45894964{3}[source]
As far as standards is concerned, that API is ARIA [0].

W3C already offers guides for accessibility and canvas. But no one who opts for canvas turns around and remembers to do their landmarks.

replies(2): >>45895531 #>>45899492 #
8. cheema33 ◴[] No.45895158[source]
> I can't hit Ctrl+F to find text on a page. I can't select text with my cursor. I can't copy the address of a hyperlink.

I was intrigued before I read this. This stuff is a non-starter for me.

9. xg15 ◴[] No.45895172[source]
It's also an interesting question, why, in traditional rich desktop applications, I can't say I have ever missed the ability to select and copy text from the UI chrome - whereas on the web I'd definitly miss it and in badly designed mobile apps, I often do.

I think some part of UI design degraded with the web, where there used to be a clearer distinction between "user data" and "app chrome" areas than there is today.

I'd also like if we could get back to selections of more complex data types at some point and not just treat everything as text. UI toolkits have all kinds of lists and treeviews to model selectable entities, whereas in the browser, there just a single huge wall of text for everything.

replies(6): >>45896257 #>>45896277 #>>45896292 #>>45896511 #>>45897528 #>>45900191 #
10. kazinator ◴[] No.45895191[source]
Let's move the goalposts downfield. If you can't go into developer mode and mess with the DOM, and JS, it's not real web.
replies(1): >>45897895 #
11. ttd ◴[] No.45895323[source]
IMHO there's no gatekeeper of what the "real" web is or should be. It grew organically - regular people building things they liked or needed. It's certainly more of a life necessity than it used to be, but that happened organically too.

I know there are strongly held opinions about this, but I for one see no reason why the "application web" can't peacefully coexist, and interlink with, the document web. In my opinion it therefore makes sense to allow for different models for the application web, ones that do not revolve around a document.

On the other hand, if we're just bashing on javascript being the lingua franca of the web, that's a train I'll happily board!

replies(1): >>45896389 #
12. afavour ◴[] No.45895531{4}[source]
Then I’m showing my ignorance… how do you add ARIA landmarks to Canvas elements?
replies(1): >>45895539 #
13. kg ◴[] No.45895539{5}[source]
You would create transparent DOM elements in the right places with the right ARIA attributes and content, I suspect.
replies(2): >>45896125 #>>45896630 #
14. charcircuit ◴[] No.45895986[source]
What screen reader? Over the last few years AI's ability to understand images has improved a lot.
replies(4): >>45896092 #>>45896785 #>>45897288 #>>45899502 #
15. cebert ◴[] No.45896092{3}[source]
That’s not exactly fast for people who need these tools though.
16. cebert ◴[] No.45896100[source]
If this can’t support web standards it’s a nonstarter for me.
17. afavour ◴[] No.45896125{6}[source]
I guess that’s what I’d like to see a better API for, then. Mapping on click events for invisible elements feels like a hack.
replies(2): >>45896440 #>>45898038 #
18. kyleee ◴[] No.45896257{3}[source]
Not being able to copy text from UI interfaces is just normalization of deviancy. It should be the norm and it’s subpar when not possible imho
19. eviks ◴[] No.45896277{3}[source]
> traditional rich desktop applications, I can't say I have ever missed the ability to select and copy text from the UI chrome

You've never had to type error code/message instead of copying&pasting? Or use search to jump to a specific settings section?

replies(2): >>45896387 #>>45897473 #
20. mastazi ◴[] No.45896292{3}[source]
> why, in traditional rich desktop applications, I can't say I have ever missed the ability to select and copy text from the UI

I do miss this on an almost daily basis and I have stopped paying for services that force me to use an app without offering a website.

The last instance of this was just a couple days ago when I could not copy a tracking number from an e-commerce app (to then paste it into the shipping company website) but at least this e-commerce company has a web UI so I could rely on that.

Oh and the other one that I miss almost daily is cmd-F / ctrl-F

replies(2): >>45897705 #>>45898475 #
21. DANmode ◴[] No.45896387{4}[source]
I’ve never done it twice, I can tell you that much!
22. DANmode ◴[] No.45896389{3}[source]
If the “application web” can’t share the text to another app,

then forget that.

23. pmontra ◴[] No.45896440{7}[source]
It's HTML imagemaps from the 90s, when we could not style buttons and navbars where GIFs with links in the right places. Browsers still have the code to render them.

https://developer.mozilla.org/en-US/docs/Web/HTML/Reference/...

https://caniuse.com/mdn-html_elements_map

24. powersnail ◴[] No.45896511{3}[source]
> in traditional rich desktop applications, I can't say I have ever missed the ability to select and copy text from the UI chrome

I forgot what desktop application it was, but there was a time that I repeatedly needed to copy texts from a dialog, which didn't support text selection. It frustrated me so much, that I put together a script to do OCR on the dialog.

Supporting complex data types for copy & paste is good; but it is almost trivial to also support plain text copying as a fallback when it already supports copying of other mimetypes. The problem is that some UI has no support of copying in any format at all.

replies(1): >>45897463 #
25. nicoburns ◴[] No.45896594[source]
Yeah. I think you need to render to actual DOM nodes when targeting the web if you want a first class experience.

We're betting on this over at https://github.com/DioxusLabs/dioxus where we're building a cross-platform UI solution that enables you to do this by having a web-centric API (we are developing our own custom HTML/CSS renderer for native platforms).

26. thayne ◴[] No.45896630{6}[source]
That's possible. But it is difficult to get right, and can have poor performance if you you have many such elements.
27. LeFantome ◴[] No.45896771[source]
MAUI was never intended for the web. This is not what Microsoft wants you to use it for.

WASM is just one of the platforms that Avalonia supports and so, if you run MAUI on Avalonia, you can run it on WASM.

If you do that though, it is going to be like rendering any other desktop GUI toolkit in WASM. It is not a web app. I mean, it is cool you can do it and MAUI in WASM is better than no web capability at all I guess. But you would never set out to create a web app in MAUI.

MAUI on Avalonia on WASM is really a modern replacement for Silverlight. And it will likely be about as popular.

The really cool thing is being able to target the Linux desktop finally. A lot of people will love that.

And, while MAUI was meant to use native controls on each platform, many people may prefer the Avalonia approach of having your app render the same everywhere.

replies(1): >>45900748 #
28. happymellon ◴[] No.45896785{3}[source]
I can't code, I'll use an LLM to write one!

I can't use your app, I'll use an LLM to read it!

29. DeathArrow ◴[] No.45897067[source]
>One issue the demos reveal is, it doesn't _feel_ like the web. That is, I can't hit Ctrl+F to find text on a page. I can't select text with my cursor. I can't copy the address of a hyperlink.

That's because MAUI is intended for mobile and desktop apps.

If you want to use .NET for front-end web SPA, you can use Blazor which will behave exactly like you asked.

30. a2128 ◴[] No.45897288{3}[source]
I'm not aware of any screen reader that works by continuously feeding screenshots of user interfaces into a remote expensive image LLM, which is an absolutely insane and impractical idea for many reasons, but I used standard TalkBack on Android
31. gmueckl ◴[] No.45897463{4}[source]
If it was a standard Windows dialog box by any chance, you could just have pressed Ctrl+C with the dialog in focus to copy the message. It's one of these subtle things that go almost completely overlooked.
replies(1): >>45901760 #
32. alasdairking ◴[] No.45897473{4}[source]
On Windows, with common messages boxes, you can just do Ctrl+C for copy and you get the message box text in the clipboard.

Don't know if that helps you particularly, but it is great when it works and little-known.

replies(1): >>45897551 #
33. osigurdson ◴[] No.45897513[source]
Agree. The examples feel a bit like I'm using a specific window in remote desktop session.
34. croon ◴[] No.45897528{3}[source]
While I do occasionally miss it there as well, I think the main difference is that I very rarely use desktop applications for information gathering.

I never "read" a desktop application, whereas that is mostly what I use a browser for. And if I can't properly interact with text on a website, then I would likely reach for something else.

replies(1): >>45897741 #
35. eviks ◴[] No.45897551{5}[source]
Thanks, doesn't help me, but you're right, a good tip to know. Though I'd still prefer a similar option to start selection directly in the UI instead of finishing the job in a text editor, this would also help highlight text in a screenshot without having to do image post-processing! I'd even accept some arcane finger-breaking ctrl-alt-win-x-y-z (which I could rebind) for the privilege

All the more annoying when such years-old fundamentals are broken in all the new "supposedly better" frameworks

36. majormajor ◴[] No.45897705{4}[source]
"E commerce apps" are very much not the sort of traditional desktop application they were referring to. Note that they add "in badly designed mobile apps, I often do."

They're referring more to things like "you can't copy the text labeling the brush width field in Photoshop" (but you CAN copy the text out of that editable field). It's a part of app design people are extremely lazy with today, as you note.

In any sensibly designed desktop package tracking app that number would've been selectable or copy-able text, like how an email subject is in a desktop email app. (Thunderbird, say.)

(Interestingly, ctrl-f to find is one that many apps/OSes have now borrowed back, with the ability to "find" items in menus through a Help menu -> Search action.)

37. majormajor ◴[] No.45897741{4}[source]
Back in ye olden days desktop applications for information gathering like Encarta let you select and copy text because they were thoughtfully designed and knew that "information you were gathering" should be different than "application chrome" - that's the distinction being made here.

Information-oriented desktop apps still do this - any good email client, for instance, should make it trivial to copy a subject line or "to"/"from" address even if it's in the UI chrome.

38. troupo ◴[] No.45897825{3}[source]
> I wonder if at any point browsers will offer a low level accessibility API for you to manually describe components

Accessibility Object Model:

https://wicg.github.io/aom/spec/

It's very slowly coming together, but it won't be rone for many years yet. Especially since what you want is Phase 3.

39. wiseowise ◴[] No.45897895[source]
Unironically – yes.
replies(1): >>45903577 #
40. MrGilbert ◴[] No.45898038{7}[source]
OTH, we are still failing to provide a bare minimum for accessibility. Heck, we even needed a law (in the EU, that than needed to be translated to national law), so that companies providing crucial end user services would care about accessibility.
41. kace91 ◴[] No.45898475{4}[source]
Most mobile experiences (and macOS desktop) let you select unselectable stuff with OCR.

For macOS is by screencap and selecting on preview, for phones in their respective “ai analysis views” usually long pressing the bottom.

I know it’s a silly flow when it could be selectable straight away, just pointing it out.

replies(2): >>45898750 #>>45899579 #
42. ludicrousdispla ◴[] No.45898737[source]
I'd just like the PgUp, PgDn, and arrow keys to reliably scroll a web page.
replies(1): >>45900219 #
43. mastazi ◴[] No.45898750{5}[source]
I never tried that, thank you!
44. pjmlp ◴[] No.45899135[source]
Isn't Webassembly cool?

We got all the plugins back.

45. zigzag312 ◴[] No.45899492{4}[source]
> But no one who opts for canvas turns around and remembers to do their landmarks.

Not completely true. Flutter has been adding some accessibility for web canvas target. [1]

I think Avalonia is in in the make it work phase. Accessibility will probably be added in the make it right phase.

[1] https://docs.flutter.dev/ui/accessibility/web-accessibility

46. nkrisc ◴[] No.45899502{3}[source]
Slow and expensive. You’re just proposing yet another “disability tax”.
47. cons0le ◴[] No.45899579{5}[source]
This is why technology is becoming garbage. In 2025 instead of copy paste, we fire up a gpu in a datacenter. it feels like "software engineering" is just becoming a BS contest for "how much AI can we shoehorn into everything"
replies(2): >>45900895 #>>45901689 #
48. Kye ◴[] No.45899708[source]
I've had the same thoughts as I watch YouTube slowly but steadily subsume "podcast."

We were all worried about something like Spotify killing off open RSS feeds for them, but there's a growing number of people who have no idea what a podcast is because people are using the term for YouTube channels with full video and no RSS feed (video or audio) to match it. Sometimes language drift is good, but not when it's done on purpose to get rid of a free and open technology in favor of silos.

"Wherever you get your podcasts" only works as long as it's built on top of an open method of syndication.

49. VikingCoder ◴[] No.45899880[source]
I can't hit my browser's back button.
50. lproven ◴[] No.45900191{3}[source]
> I can't say I have ever missed the ability to select and copy text from the UI chrome

Good heavens. I boggled at this.

It's not every single day, but probably at least once a week I am frustrated by this, and have been since the rise of PC GUIs -- so, coming up on 35 years now. It was often doable on DOS-era PCs, especially if you had a mouse, or a multitasking environment like DESQview, or best of all, both.

replies(1): >>45902702 #
51. lproven ◴[] No.45900219{3}[source]
Oh my yes.

I want every app and every web page to be 100% navigable if I do not have a pointing device attached to my computer.

And I want this enforced by law, by large rich countries. Accessibility to people with disabilities would be a good way: if your product or service is not accessible to people who can't see, can't use a mouse, or can't use their hands at all, then you can't sell it.

52. JamesSwift ◴[] No.45900748[source]
Blazor+MAUI has absolutely been a focus of development from the start. What Im seeing with this is that MAUI is somewhat throwing in the towel and hoping to offload to avalonia to take the torch of development. I'm sad, because I was pretty in the weeds with MAUI at the start, as I was building a greenfield app at the time. It had a ton of potential to be a reimagining of Xamarin and how it fit into the broader .net ecosystem but they just shot themselves in the foot (both MAUI team and the broader MS dev efforts).

I havent been in that space for a couple years now so maybe they have gotten better, but I doubt that. I appreciate the heroic efforts of the MAUI team, but I think its just the unfortunate reality.

53. kace91 ◴[] No.45900895{6}[source]
Not fully disagreeing, but this lack of copypaste is not an intended ai feature.

- The “magic ocr thingy” exists for things like taking a picture of the real world and grabbing text from it, or grabbing text from a video from something you saw recorded there. Think translating a foreign sign or whatever.

- interfaces have, for unrelated reasons, become more hostile to standard actions like copypaste.

As a result people end up having to ocr-scan interfaces with the tool.

54. thewebguyd ◴[] No.45901689{6}[source]
Some of it is because how people interact with and use tech has changed.

Mobile users have completely outpaced laptop/desktop users, and mobile users don't think in terms of files and text, so to them copy & paste is less important. The mythical "average user" moves arbitrary text and data around using screenshots and screen recordings instead of text and files.

Yes, it's incredibly inefficient, but I think it's evolved that day because selecting text is a real pain on a small touch screen, and companies have been trying to abstract away any concept of a filesystem for a long time.

So you or I might care and be bothered that we can't copy & paste something from UI chrome or content in a "web app" but the average person won't care, they'll just take a screenshot.

55. thewebguyd ◴[] No.45901760{5}[source]
There's a lot of nice little things like that in desktop OSes that we completely lose with everyone shifting to using electron, and I'm increasingly frustrated by it as time goes on.

on macOS, anything that uses the OS text input box has emacs keybindings. Universal text editing bindings across the entire OS for all native apps. You lose that with electron, just like you lose a lot of the windows niceties the moment apps stop using win32 and start overriding with their own custom UI toolkits in the name of "branding."

It's part of the big reason computers started to be perceived as difficult to use, and it's not because of the various operating systems. It's because desktop apps stopped respecting the OS and the user, so instead of only needing to learn the operating system's conventions, which would apply to every app built for it, you now have to learn every individual app's quirks and conventions.

The web just continued to make it worse where now every app is it's own little special snowflake.

56. jermaustin1 ◴[] No.45902162[source]
> They are islands of richness within a web page.

1000% - as a dotnet developer with 20 years under my belt, I currently don't see the reasoning behind this. With modern browsers, CSS/JS/HTML does SO much, you just don't have XAML. I like XAML (conceptually), but there is JSX for similar functionality, and it is at least compiled into real HTML, not just a applet.

I felt the same with silverlight as well. Why do we keep trying to reinvent Flash? We already have a far superior C# Flash in Unity compiled for Web (kind of a joke, but also not).

57. tracker1 ◴[] No.45902702{4}[source]
Same, and especially with error messages/dialogs.
58. kazinator ◴[] No.45903577{3}[source]
By the way my comment was likewise already unironic.