Talk:Acid3
From Wikipedia, the free encyclopedia
[edit] Archive
Old siscussions for this page has been archived.
- Talk:Acid3/Archive 1 —Preceding unsigned comment added by Itpastorn (talk • contribs) 18:34, 8 April 2008 (UTC)
[edit] What is being tested?
I have changed the article to reflect this sentiment: "Acid3 is primarily concerned with ECMAScript and the DOM though Selectors Level 3, Media Queries, and data: URIs are also tested."[1] There is very little CSS and SVG in this test.
From Ian's comments: "there are 6 buckets with 16 tests each, plus four special tests (0, 97, 98, and 99)"
- Update: This quote is now gone from the source code. It's still true, though.--itpastorn (talk) 13:30, 16 February 2008 (UTC)
- Bucket 1: DOM Traversal, DOM Range, HTTP
- Bucket 2: DOM2 Core and DOM2 Events
- Bucket 3: DOM2 Views, DOM2 Style, and Selectors (CSS 3 selectors)
- Bucket 4: HTML and the DOM
- Bucket 5: Tests from the Acid3 Competition (contribued by the "public"; SVG, HTML, Unicode...)
- Bucket 6: ECMAScript
Test 99 "The weirdest bug ever"
--itpastorn (talk) 11:35, 6 February 2008 (UTC) Modified: --itpastorn (talk) 13:30, 9 February 2008 (UTC)
According to the announcement from The Web Standards Project, the following is being tested:
- DOM2 Core
- DOM2 Events
- DOM2 HTML
- DOM2 Range
- DOM2 Style (getComputedStyle, …)
- DOM2 Traversal (NodeIterator, TreeWalker)
- DOM2 Views (defaultView)
- ECMAScript
- HTML4 (<object>, <iframe>, …)
- HTTP (Content-Type, 404, …)
- Media Queries
- Selectors (:lang, :nth-child(), combinators, dynamic changes, …)
- XHTML 1.0
- CSS2 (@font-face)
- CSS2.1 (’inline-block’, ‘pre-wrap’, parsing…)
- CSS3 Color (rgba(), hsla(), …)
- CSS3 UI (’cursor’)
- data: URIs
Tests added by the open competition, including some on SVG, is not listed by WaSP. --itpastorn (talk) 13:36, 9 February 2008 (UTC)
Even more links about what is being tested:
- John Resig - Acid 3 Tackles ECMAScript
- SVG added through the open competition (From the guy who contributed most of them...) See also this message on the SVG mailing list and this one.
--itpastorn (talk) 13:54, 9 February 2008 (UTC)
I am adding this link about the Ahem font for future reference as well. It also features prominently in MS CSS 2.1 tests. And we really should have references to the formal test suites as well.--itpastorn (talk) 18:46, 8 March 2008 (UTC)
The test for the downloaded font is the white 'X' with a fuchsia background. If the font is downloaded the it will not be visible as the font being used is the Ahem test font -- the glyph for the X character is a rectangle with no padding, so correctly rendered it will be a white rectangle in the upper right corner of the test, on a white background so is invisible when rendered correctly. I have tested the webkit nightlies, but am unable to test IE. -- 24.130.131.58 (talk) 06:15, 9 March 2008 (UTC) (Moved to this section.)--itpastorn (talk) 12:28, 9 March 2008 (UTC)
Linkdump: CSS selectors tested --itpastorn (talk) 12:24, 29 March 2008 (UTC)
Linkdump again: Ian explains the "smoothness" criteria in more detail
[edit] Not a test suite
This is from a private mail to me from Ian H:
Acid tests aren't test suites, they're demo pages that attempt to exercise many aspects of standards in order to encourage people to pressure browser vendors to consider standards-compliance a priority. If browser vendors made test suites and fixed the bugs that the test suites found, then they wouldn't have any bugs left for Acid tests to pick on.
This means that both this article and Acid2 really should be re-worded.--itpastorn (talk) 10:38, 3 March 2008 (UTC)
- This is exactly what a test suite is. It just doesn't test all features of the specs tested. The nuance about the purpose and the targeted public doesn't change the nature of a test. --Fenring (talk) 11:56, 3 March 2008 (UTC)
- A test suite is a collection of individual standalone tests. Acid tests are not. Annevk (talk) 16:38, 5 March 2008 (UTC)
- On the sites http://www.webstandards.org/ and http://www.acidtests.org/ Acid2 or Acid3 are consistently called "test page(s)" or simply "test(s)", never "suite(s)". So, does anyone have a more authoritative source than that?--itpastorn (talk) 09:17, 13 March 2008 (UTC)
- But they meet the definition of Test Suites , don't they? ffm 19:02, 13 March 2008 (UTC)
- Nope! One might tentatively argue that Acid3 is a test harness, but it is not a suite. BTW, considering the discussion on the Acid2 page about my perceived OR when I deduced through simple reasoning (and provided resources) that IE 8 beta 1 fails. I have sourced the use of the word page. Who can source the use of the word suite?--itpastorn (talk) 21:26, 13 March 2008 (UTC)
- Synthesizing material to reach a conclusion certainly is original research. On the other hand, using simple terms in a way that everyone agrees on is not. What do you mean by "source" the use of words? Just use words. -- Schapel (talk) 21:38, 13 March 2008 (UTC)
- Nope! One might tentatively argue that Acid3 is a test harness, but it is not a suite. BTW, considering the discussion on the Acid2 page about my perceived OR when I deduced through simple reasoning (and provided resources) that IE 8 beta 1 fails. I have sourced the use of the word page. Who can source the use of the word suite?--itpastorn (talk) 21:26, 13 March 2008 (UTC)
- But they meet the definition of Test Suites , don't they? ffm 19:02, 13 March 2008 (UTC)
- On the sites http://www.webstandards.org/ and http://www.acidtests.org/ Acid2 or Acid3 are consistently called "test page(s)" or simply "test(s)", never "suite(s)". So, does anyone have a more authoritative source than that?--itpastorn (talk) 09:17, 13 March 2008 (UTC)
- A test suite is a collection of individual standalone tests. Acid tests are not. Annevk (talk) 16:38, 5 March 2008 (UTC)
[edit] Shift+click A
Should this information be in the article? It has now been removed twice.
Personally I think it makes sense, as opening the results in a new tab to me is preferable to opening them in a JavaScrip alert box. The fact that it is possible to see the results by clicking the A is not obvious in any way, unless you accidentally hover over the letter. That you get a different result from clicking while holding down shift is even harder to know.
Maybe one could rephrase the instruction, but I do think it is of value to the reader.--itpastorn (talk) 08:21, 5 March 2008 (UTC)
[edit] Betas
Not including information on beta releases is a great way to artifically reduce the quality and usefulness of this article. This is not a good goal -- think about what our readers would hope to find when visiting Wikipedia; they want to know the latest information that we can get from reliable sources. This includes the current development state of major browsers, especially when it's something like Internet Explorer 8. -/- Warren 00:23, 6 March 2008 (UTC)
- First of all it is a matter of WP policy. In what way is it not original research? I have proposed a solution on this very talk page, where we could have the information about "compliance efforts" (good catch renaming the section, BTW), written in such a way that it is of encyclopedic value, and not recentism.--itpastorn (talk) 10:47, 6 March 2008 (UTC)
-
- You probably shouldn't be trying to use the "recentism" argument on an article that describes something that was officially announced just three days ago. Also, you are misunderstanding the thrust of the recentism essay. The goal is to dissuade people from adding information that isn't important or doesn't have long-term value. In the context of Acid3, the state of browser support is absolutely vital to the topic, because it is very much a current issue, one that our readers will be interested in tracking. Also, original research is effectively countered by reliable sources, and in the case of software, OR arguments are weakened by the use of screenshots. -/- Warren 13:02, 6 March 2008 (UTC)
-
- I believe that including the latest information with regards to preview releases and betas is very important to the article. Showing the differences between version X and version Y of the same browser gives the reader a perspective on the difficulty and progress of implementing standards compliance in browsers. Because browser standards implementation develops rapidly compared to other types of software (e.g. Word Processing), it is especially important to have the most up-to-date information. Secondly, people who come to this web page will be looking at which browser performs best, perhaps to make an informed decision about which browser to use, or which browser to test their web content in. Due to the nature of the Acid3 test (it was explicitly designed so that none of the current browsers pass the test) I believe it is very important to show the renderings of upcoming browsers. - ARC GrittTALK 13:20, 6 March 2008 (UTC)
-
-
- Nightlies are unstable, unfinished softwares with experimental features and regressions. These are definitely not long-term informations. If you consider that the percentages of passed test is an important information, why don't you provide more details about e.g which subtests are passed and which are not ? This is crazy. Who needs that ? It's not encyclopedic. Though, a notable information that will be in the article forever is the first engine (beta or not) to pass the test (it means fully). Look at the Acid2 article. It's much more informative than these everchanging values. And Warren, the inclusion of this article is not recentism. It is there to stay. It is very persistent information in web history. --Fenring (talk) 15:53, 6 March 2008 (UTC)
- Look at how ACID2 does it, and perhaps copy from there? I do think noting the status of the various engines at the release of the test could be interesting and useful. IE7 had 17 points as of the release, safari has 33 points, etc. That gives readers an idea of how things started out with the official test. I will say regardless, this test is quite important in the world of web programming and browser development. All major browsers still don't pass ACID2 in their release versions, still waiting on IE8 here. :) I'm just commenting here because I read the article. LinEagle (talk) 23:13, 8 March 2008 (UTC)
- The Acid2 article shows when each browser passed for "compliant" applications and screenshots for "non-compliant" applications. Because no browser passes Acid3, that means we're left with screenshots for each browser until some browsers pass. The score at time of release has no purpose, because many browsers (especially Safari and also Firefox) have been specifically fixing bugs that lower their score for months, so they do not how how each browser "started out". -- Schapel (talk) 00:24, 9 March 2008 (UTC)
- Well, of encyclopedic value is, IMO, not so much the scores per se as how this test has caused vendors to improve their products. I can do without the scores at the time of the release per se. But what happened from the date Anne V K first told the world about the test until it was released? What has happened since? Since this article is about the test, its details and purpose, and its impact - not about browsers! - this should be the focus of the article. And I note that apart from small grammar fixes so far I am the only one who actually is contributing substance to the article in this regard. That's the reason I removed the screenshot with Webkit scoring 90 and reinstated the screenshot where webkit scored 88. It illustrates the text better.--itpastorn (talk) 15:34, 11 March 2008 (UTC)
- The Acid2 article shows when each browser passed for "compliant" applications and screenshots for "non-compliant" applications. Because no browser passes Acid3, that means we're left with screenshots for each browser until some browsers pass. The score at time of release has no purpose, because many browsers (especially Safari and also Firefox) have been specifically fixing bugs that lower their score for months, so they do not how how each browser "started out". -- Schapel (talk) 00:24, 9 March 2008 (UTC)
- Look at how ACID2 does it, and perhaps copy from there? I do think noting the status of the various engines at the release of the test could be interesting and useful. IE7 had 17 points as of the release, safari has 33 points, etc. That gives readers an idea of how things started out with the official test. I will say regardless, this test is quite important in the world of web programming and browser development. All major browsers still don't pass ACID2 in their release versions, still waiting on IE8 here. :) I'm just commenting here because I read the article. LinEagle (talk) 23:13, 8 March 2008 (UTC)
- Nightlies are unstable, unfinished softwares with experimental features and regressions. These are definitely not long-term informations. If you consider that the percentages of passed test is an important information, why don't you provide more details about e.g which subtests are passed and which are not ? This is crazy. Who needs that ? It's not encyclopedic. Though, a notable information that will be in the article forever is the first engine (beta or not) to pass the test (it means fully). Look at the Acid2 article. It's much more informative than these everchanging values. And Warren, the inclusion of this article is not recentism. It is there to stay. It is very persistent information in web history. --Fenring (talk) 15:53, 6 March 2008 (UTC)
-
[edit] The new table
Kudos to Schapel for his work in getting the table together. It looks good. I have one comment, though... there's no information as to which release is referenced by the screenshots. Could this be incorporated somehow? -/- Warren 19:47, 13 March 2008 (UTC)
[edit] CSS is a technology, described in a spec that may be at a draft stage. Check the W3C standardization process.
It is factually wrong to call downloadable fonts and text-shadow drafts. They are CSS technologies described in drafts.
It is factually wrong to say that Acid3 requires support for the drafts in which these technologies are mentioned. The specs contain many things not in the test.
CSS is a technology, a declarative markup language to be more exact, described in specs that may be at a draft stage. Check the W3C standardization process.
Also, if you look at the specs, almost every CSS spec is at the draft stage. However, individual items from those specs are at a very stable state. Therefore it is actually somewhat misleading to call downloadable fonts and text-shadow drafts (they are not mentioned in the Beijing document, but have been on the CSS mailing list).
You may also see that some specs are about to be demoted from the CR to the WD stage. And the only recommendations that are finished (1.0 and 2.0) have been declared obsolete.
And yes, the W3C also call their languages technologies: W3C technology stack --itpastorn (talk) 23:25, 13 March 2008 (UTC)
- Wow, that's a big pile of steaming........ stretch.
- I have a novel idea for you: RESEARCH YOUR CLAIMS. Do it. Don't fucking argue. Don't fucking edit war. Don't fucking engage in original research. None of those things are welcome on Wikipedia. An utterly simple Google search on the term "CSS Technology" doesn't return anything interesting about Cascading Syle Sheets, and only about 30,000 results total. ("css technologies" returns less than 3,000 hits). The W3C does not describe CSS as a "technology". I will repeat that in bold letters: The W3C does not describe CSS as a "technology". The word does not appear in the specification! This means that we do not describe it as a technology, either. This is not up for debate or discussion. As a Wikipedian who is bound by WP:V, WP:OR and WP:RS, you absolutely do not reserve the right to invent terminology, or to promote rarely-used terms. CSS is a specification, not a technology. It says so right in the title. CSS is a standard, not a technology. CSS is a language, not a technology.
- Now before your male ego gets all fired up for an argument because I've just told you that you're wrong... STOP. THINK. RESEARCH. Do you want to do this using the valid, authoritative information we have available to us, or not? CSS3-text clearly identifies itself as a working draft. CSS3-webfonts clearly identifies itself as a working draft. The beijing document is completely irrelevant because it doesn't mention CSS3-text and CSS3-webfonts. Acid3 tests things that are in the CSS3-text and CSS3-webfonts documents, and doesn't mention the beijing document at all. Acid3 uses things that are declared in draft standards. That's the bottom line. You're wrong -- don't fight this, you won't win. -/- Warren 23:50, 13 March 2008 (UTC)
Third Opinion:
-
- Guys, calm down.
- Warren, Please be WP:CIVIL. User:Itpastorn hasn't swore, yelled (IN CAPS), etc. He just reverted you, once.
- Itpastorn: they are actualy "W3C Working Drafts". However, they are drafts of technologies. You can call them both, or just go with W3C Working Drafts of the CSS standard. ffm 00:14, 14 March 2008 (UTC)
-
-
- Two questions. Yes or no, A or B. (1) Is CSS part of what W3C calls the "technology stack"? (2) Is the word "draft" used by the W3C to denote a document at a certain stage (A) or something described within such a document (B) according to the described standardization process?
-
-
-
- BTW, the Beijing document was not introduced to support the claim that downloadable fonts and text-shadow per se have passed the draft stage. It was an example about how the W3C CSS Working group are trying to illustrate the principle that some parts of CSS 3 are implementable even if they are described in specs that as whole still are at the draft stage. I did not propose we put any info about the current readiness of a certain CSS technology in the article. I have no inclination to wade through the mailing list archives and other discussions from the W3C Working Group. I proposed we'd remove it, as it is quite irrelevant to the article - and when badly worded also misleading.
-
-
-
- @Firefoxman. Thanks for your admonition. I am actually very calm as I have researched this issue by reading quite a lot of W3C documents in my day, as well as having participated on the CSS WG public mailing list and the WHATWG mailing list for quite some time now, and I am not shaken at all by Warren's screaming and cursing. I know my W3C terminology.
-
--itpastorn (talk) 00:48, 14 March 2008 (UTC)
-
-
-
- I don't think what W3C does with CSS can be called "technology". It just says how the markup is to be interpreted. The "technology" part of realizing that is left to the browser makers. I think a better working would be "...downloadable fonts and text shadow specifications, which are under consideration by W3C for standardization". And those who are not comfortable with the word "standardization" (W3C isn't a standards body, it cannot propose standards; it can only do recommendations), replace it with "recommendation"-derived word of your choice. --soum talk 05:29, 14 March 2008 (UTC)
-
-
-
-
-
-
-
- I made the edits along with a couple of other changes. Feel free to modify it as necessary. One thing I would like to point out: "In order to render the page with the required pixel perfection..." - the rendering cannot be pixel perfect with the reference rendering, nor will it be identical across browsers as the browsers handle text rendering differently, especially subpixel rendering. So, its better not to mention being "pixel-perfect". --soum talk 10:51, 14 March 2008 (UTC)
- Soum, I think on the same browser/platform, the test and the reference rendering must be pixel-identical. Even if the reference rendering is different across different browsers. --Fenring (talk) 14:59, 14 March 2008 (UTC)
- I made the edits along with a couple of other changes. Feel free to modify it as necessary. One thing I would like to point out: "In order to render the page with the required pixel perfection..." - the rendering cannot be pixel perfect with the reference rendering, nor will it be identical across browsers as the browsers handle text rendering differently, especially subpixel rendering. So, its better not to mention being "pixel-perfect". --soum talk 10:51, 14 March 2008 (UTC)
-
-
-
-
-
-
-
-
-
-
- I am sorry I am not getting you. Are you implying there are multiple reference renderings, one for each OS/browser combo? --soum talk 15:08, 14 March 2008 (UTC)
- I am. If you look at the source code of the reference rendering page, you'll notice it's not a raster image, but html/css instead (that uses simple features implemented by every current UA). The rendering must be the same with this simple way and the complex-test way, for one user-agent. But it not required to render the same across browsers. --Fenring (talk) 15:24, 14 March 2008 (UTC)
- I am sorry I am not getting you. Are you implying there are multiple reference renderings, one for each OS/browser combo? --soum talk 15:08, 14 March 2008 (UTC)
-
-
-
-
-
[edit] A few more notes about sources
Since I believe myself to be the one who has contributed most of the factual content about what is being tested, how the "buckets" work and get their color, etc, I think I should explain my sources a bit more clearly. Not every claim is validated with a footnote right now. My main source is the source code of the test, which means that it is verifiable, but not in a simple fashion - even though Ian has put many helpful comments in the source (I've studied it thoroughly). When WaSP releases its companion guide we will get a better resource. Until that time comes did I however believe that people might want to know more about the test than what the current score is for browser X. Footnotes will be provided in due time!
The test does not test compliance with the Web Fonts draft, as it is not a full test suite. My reference was not the full draft but one item in it. For example, Acid3 does not test "font-stretch" or "unicode-range". Downloadable fonts is however a part of this spec that is in very high demand and therefore is unofficially declared implementable. I would not dream of saying that in the article, as it would take me a long time to dig through the mailing list and bug databases in order to source it. But this is a talk page and I want to explain my thinking.
Similarly, the test does not test for compliance with the CSS Text Level 3 draft. Hyphenation is one example of what is not being tested. "Punctuation-trim" is another. Whitespace, word-spacing and letter-spacing, OTOH, are in. And the much longed for text-shadow. Once again my reference was to an individual item in the draft.
I happen to know that downloadable fonts and text-shadow is in high demand by designers, and it is factually correct that Acid3 checks for it. I could have mentioned letter-spacing, but that topic is not so hot. Therefore I did not prioritize it. BTW, want to know why FFox 2 does not render the buckets as squares, but as lines? It does not support "inline-block"! (Line 36, column 33 in the source code.)
If you think that all of this is OR, by all means feel free to remove the entire section from the article.--itpastorn (talk) 01:38, 14 March 2008 (UTC)
- In the absence of any reliable source that contradicts what's in the article, just put {{fact}} everywhere a citation should be. Someone finds a reliable source that says something different, they can remove your OR, and if someone challenges your OR after it's been marked as needing a citation for a long time, they can remove it. But we shouldn't remove it immediately just because it's OR. -- Schapel (talk) 11:30, 14 March 2008 (UTC)
[edit] Current events
Perhaps we should stick this template into the article above the table with the scores:
This section documents a current event. Information may change rapidly as the event progresses. |
BTW, Webkit is at 91[2], but since they have no working code at all for SMIL that i know of, I suspect it's going to be a while for them to reach 100.--itpastorn (talk) 21:53, 15 March 2008 (UTC)
- The test has been changed slightly. It appears that most browsers will get an automate 1 point bump in their scores. I don't know how to best add this news to the article so I'm posting it here. http://webkit.org/blog/161/webkit-hits-93100-in-acid3/ —Preceding unsigned comment added by Pattersonc (talk • contribs) 01:24, 18 March 2008 (UTC)
Yeah, I get 53/100 with FF2 now. —Preceding unsigned comment added by 81.182.143.92 (talk) 09:36, 19 March 2008 (UTC)
- When are we going to replace the screenshots of the test rendering to accoint for the 1 pt. bump? --soum talk 17:06, 23 March 2008 (UTC)
[edit] AcidAhem downloadable font
I first put the info in, then I thought I was wrong and now Anne VK has changed it back to my initial understanding. These are the two lines of code (I split the 2nd one up here to avoid scrolling):
@font-face { font-family: "AcidAhemTest"; src: url(font.ttf); } map::after { position: absolute; top: 17px; left: 639px; content: "X"; background: fuchsia; color: white; font: 20px/1 AcidAhemTest; }
It's line 25 and 26 in the source code of the test.
17 pixels down and 639 pixels to the right. That can't be the purple X (seen above the instructions on the FFox screenshot - right?) But it's still "background: fuchsia". That can't be the red square in the upper right corner - right?
So looking at the screenshot in Opera 9.26 it is in a more reasonable position, almost at the top.
I conclude that Gecko puts this at the wrong place, but it is indeed the white X on fuchsia background that is not supposed to be seen. Buggy browser however might not put the glyph in the correct position. Now I need a source besides the source code of the page - and a good way to phrase the article text...--itpastorn (talk) 16:41, 18 March 2008 (UTC)
[edit] The stable photos
I think the stable photos should be permanent, i.e. we don't update them when the new version of the browser goes stable.
The pictures should document browsers as they existed at the moment ACID3 was created. This will show the impact of the test, and how it influenced browser development. In fact I think we should add a column for 'Development build as of the release date of the test'.
The Development column should be kept up to date - for now, until all the browsers pass, and then should be removed.
Comments? Ariel. (talk) 03:26, 24 March 2008 (UTC)
- Makes sense, but add a "current stable" if an updated stable does not completely pass, but is different than the initial version. There's no reason to put up photos of what it looks like when it passes, however. ffm 17:10, 25 March 2008 (UTC)
- It doesn't make any sense to me. There was no "moment of creation" for Acid3. Developers of the browsers were very busy fixing bugs in their browsers for months before Acid3 was officially released. Not to mention that the whole point of Acid3 is to get browser developers to release a stable version that passes the test. To me it serves no purpose and misleads readers of the article as to what the purpose of Acid3 is. How well browsers did before the test was released is of no consequence. I think the table should remain as is, updating the stable and development screenshots as new versions are released, until a stable release of each browser passes Acid3. When that happens, its row should be removed. -- Schapel (talk) 18:34, 25 March 2008 (UTC)
-
- "misleads readers of the article as to what the purpose of Acid3 is" - actually quite the opposite! By showing the sudden improvement in browsers we show how the acid3 test strongly influenced browser development. Look at webkit for example - they would never have made all those fixes if not for acid3. By showing what webkit looked like before acid3 was released we show what acid3 did to browser development. Ariel. (talk) 20:40, 26 March 2008 (UTC)
-
-
- And exactly how does the current article not show the sudden improvement in browsers and show how the acid3 test strongly influenced browser development? It seems clear to me. What doesn't make sense is showing how browsers did before the test was developed. It serves no purpose. Perhaps after all browsers pass the test, we could show the most popularly used browsers that do not pass and how well they do. That would be useful, to demonstrate that even though all browsers pass, web developers cannot simply use all the features tested, as older browsers that do not pass are still in common use. -- Schapel (talk) 00:01, 27 March 2008 (UTC)
-
- I like the idea but I don't think we should have images for each stable revision of a browser, just text to show the progress that was made from the time the Acid3 was released to when it passed.
example:
"History of Acid3 Progress"
• Firefox 2.0.0.9 - 52/100 - 2007/12/01
• Firefox 2.0.1.1.- 74/100 - 2008/04/01
• Firefox 2.1.0.2 - 85/100 - 2008/09/01
pattersonc (talk) 03:17, 26 March 2008 (UTC)
- I'm using Firefox 2.0.0.6 and it passes 53/100. Whats gives? —Preceding unsigned comment added by 202.1.192.5 (talk) 08:22, 3 April 2008 (UTC)
[edit] Formal tests
I propose we make a list article about every major test or test suite for browsers. The Acid tests serve a purpose, but passing formal test suites from W3C is more important. I think we should try to raise awareness and improve WP's encyclopedic value by making a page like I have started sketching out at User:itpastorn/browsertests.--itpastorn (talk) 11:31, 24 March 2008 (UTC)
- Rather than create a new article, why not add them to the relevant article:
- -- Schapel (talk) 12:32, 24 March 2008 (UTC)
[edit] Webkit cheating?
Got myself linked to this trac, and it looks like webkit is doing a special exception incase it is the acid 3 font in order to pass the test. Source: http://trac.webkit.org/projects/webkit/changeset/31322 I refrained from editing before looking into the matter more carefully. Lyml (talk) 14:47, 27 March 2008 (UTC)
- Mozilla developer Mike Shaver says Safari is treating the Ahem font as a special case: http://shaver.off.net/diary/2008/03/27/the-missed-opportunity-of-acid-3/ This, of course, defeats the purpose of the Acid3 test. -- Schapel (talk) 16:02, 27 March 2008 (UTC)
-
- Yes, that change is quite specific to that font, which of course is generally frowned upon (hardcoding something just to beat an internet standards test doesn't improve anything). However, you should also look at the related bug for this to see both sides: [3]. nneonneo (talk) 19:31, 27 March 2008 (UTC)
-
-
- At least this act could be cited as proof to support the notion that Apple/Webkit really wanted the PR of winning this race! Personally I also believe people should make a clear distinction between commitment to standards and commitment to winning the Acid3 race per se. In my comment on Mike Shavers blog [4] I have provided a strong arguments (IMHO) that Mozilla might actually display a higher commitment to standards - by postponing some Acid3 fixes! see also this comment on Mozilla Bugzilla
-
-
-
- What is of encyclopedic value, though, is what kind of techniques that developers can use and users enjoy, once the technologies in Acid3 have widespread support from stable browsers. (And if a dev is using progressive enhancement, widespread does not mean wait for IE...) Putting such stuff into the article is way more productive than scores or discussing if a browser cheats or not.--itpastorn (talk) 10:43, 28 March 2008 (UTC)
-
-
-
-
- However the techniques the developers can use are embedded fonts with the name 'Ahem' if you want them to act correctly. This is just silly and should atleast get a mention in the 'pixel perfect' remarks. Which wouldn't be pixel perfect if the test was exactly the same except the font name was changed to something else than 'Ahem'. It's not really fair to call webkit xxx the first browser to render acid3 test pixelperfectly if all they did was make a special hardcoded exception for the test (even though it was just for font rendering in this case, and not for the entire test suite). Well I'll still refrain from editing (as this will surely cause an edit war where people are arguing over silly things like who came first). I don't beleive it is relevant, however should it be noted, it should atleast be the thruth. Lyml (talk) 23:26, 28 March 2008 (UTC)
-
-
-
-
-
-
- Hixie is now changing the test and the WebKit team will back-out the hardcoded behavior [5]. So, the question isn't relevant anymore from an encyclopedic point of view.
-
-
-
-
-
-
-
-
- The change means that WebKit r31356 no longer is pixel-perfect. Tim Altman (talk) 20:58, 31 March 2008 (UTC)
-
-
-
-
-
-
-
-
-
-
- Do you have a source for these claims? It doesn't make sense to me, as moving the graphics the way they did should mean WebKit would render the test correctly whether the Ahem font was antialiased or not. Besides, it was an issue only on Macs, and WebKit also runs on Windows (Opera tellingly did not release a Mac version of WinGogi that renders the test correctly). From an encyclopedic point of view, all that matters is that by the end of March, there were early development versions of Presto and WebKit that score 100/100 and render the test correctly. -- Schapel (talk) 13:34, 4 April 2008 (UTC)
-
-
-
-
-
[edit] Timeline of compliant layout engines
I think this section should remain commented out until at least one browser actually passes the Acid3 test. We already have better information about browsers that come close in the previous section. -- Schapel (talk) 18:46, 27 March 2008 (UTC)
- Agreed. There's no point in calling them "partially compliant" -- they either are, or aren't (and all browsers currently released fall into the latter category, especially because of test 26, the performance test). (by the way, I hit enter accidentally while entering the edit summary for [6]; if anyone was curious, I meant to say "Restore comment (no point in saying they are partially compliant)") nneonneo (talk) 19:34, 27 March 2008 (UTC)
Actually, having a timeline at all emphasizes the "race" aspect that has nothing to do with what the Acid3 test is about. This race is just leading to anonymous editors coming in and adding inaccurate information to this article. It doesn't really matter when the layout engines that pass were released. I propose simply listing the layout engines that pass after a stable release that passes is released. -- Schapel (talk) 14:14, 29 March 2008 (UTC)
- I see no way of stopping that. Sigh! We just have to revert it. As for Webkit, until the tracking bug is closed or we get an official announcement from dave Hyatt we just have to keep saying any talk of Webkit passing is just a rumor. Right now they are opening more bugs about the glitches related to caching and JavaScript speed. I am quite sure Opera will issue official statements as well. And then we have the issue of Ian saying that he is still not sure exactly what speed measurement that should be used to monitor the third criteria. I.e. the test itself is still not completely finalized!--itpastorn (talk) 19:12, 29 March 2008 (UTC)
-
- I also think we should eliminate the "browser competition" section. The Acid3 is not a competition. It has nothing to do with which browser does best or which one passes first. I think we should remove all dates from events that don't have to do with the test itself. Stating the current status of the latest stable and development builds is the most important information. -- Schapel (talk) 04:42, 30 March 2008 (UTC)
-
-
-
-
- Agreed. That there was a race between Opera and Safari developers is notable. That there were public releases of WekKit and Presto that scored 100/100 and rendered the test correctly by the end of March 2008 is notable. A timeline of events or who did what first, however, is not notable. -- Schapel (talk) 15:14, 2 April 2008 (UTC)
-
-
-
Instead of a timeline (which makes it seem like Acid3 is a race), I propose we list the first stable versions of browsers and other programs that pass Acid3. This would not only clarify which versions of which programs pass Acid3, but would also emphasize that having a layout engine that passes Acid3 doesn't do much good until programs that use it are released for general use. Perhaps it could look like this:
Layout engine | Programs |
---|---|
Presto | Opera 10 |
WebKit | Safari 3.5, OmniWeb 6 |
The name of the section could be Compliant layout engines and programs. -- Schapel (talk) 13:16, 12 April 2008 (UTC)
[edit] Updates needed
The current nightly build of WebKit passes the Acid3 test 100%. I think we should update the article to reflect this. --156.111.38.218 (talk) 23:16, 30 March 2008 (UTC)
Sorry, this has already been done. Thanks. --156.111.38.218 (talk) 23:21, 30 March 2008 (UTC)
WebKit doesn't pass. They still have performance issues. See http://bugs.webkit.org/show_bug.cgi?id=17510. In other news, the WebKit section says, "WebKit build r31356 scores 100/100 and produces a correct rendering", but that's not true. On March 29th, Ian Hickson updated the test again (http://ln.hixie.ch/?start=1206756775&count=1) to change anti-aliasing. This caused older WebKit builds to have rendering problems. Tim Altman (talk) 00:10, 31 March 2008 (UTC)
Opera scored 106 with developing build —Preceding unsigned comment added by MartinZM (talk • contribs) 04:07, 3 April 2008 (UTC)
[edit] Wii Internet Channel
It may be interesting to note that the Acid3 test not only fails on the Wii's Internet Channel, but it completely freezes the browser...as well as the entire system. Its effect is so profound as to force the user to turn off the Wii using the Power button on the console itself, or unplug it.
Just throwing that out there... Kewlio (talk) 07:03, 1 April 2008 (UTC)
[edit] David Baron
http://dbaron.org/log/20080406-acid3
Do you think this Mozilla Dev's op-ed about his plans to implement to the test are relevant? It might be problematic in that it would be more difficult to get responses from devs of some of the other layout engines. gren グレン 10:18, 9 April 2008 (UTC)
- After reading the piece, it looked to me that the most useful piece of information is debunking the idea that the browsers that score 100/100 do so because they support more standards. I think the article needs more information on what the purpose of the test is (to me, it is about browser developers cooperating, not competing) and how to interpret the score of the test (the score does not reflect general standards support, but merely how well browsers do on what the Acid3 test tests). -- Schapel (talk) 12:16, 9 April 2008 (UTC)
-
- If one follows the movement on Bugzilla for Gecko on bugs related to Acid3, there is movement on three issues: Text shadow - probably not enough stability to make int FFox 3, CSS 3 selectors - might make it into FFox 3 and media queries - which again probably won't. I think it is reasonably clear that these issues have received a slightly higher priority thanks to Acid3. However, SMIL is still not on the radar, and for sure will not be implemented just to pass the test. (Webkit is continuing to improve its SMIL support, even though they have "enough" to pass the test. I am following their bugzilla too.) What David baron has done is to take open issues about CSS selectors to the CSS WG and discuss them, while implementing, delaying Acid3 performance in favor of a better Standard! I think this is one prime example of how commitment to standards meanS (A) not (B) yet passing Acid3. (This can be followed on the CSS WG issues list, Bugzilla and the CSS WG mailing list.)
-
- But today I googled a bit on Acid3 to check for new sources. The following stood out: (1) Almost everyone writes about it as if it's a race. (2) Almost everyone who writes about, except for official sources, have really no clue about what is being tested. The Guardian even claimed it was a test of the "latest" HTML standards" from W3C! (3) The smoothness criteria is really hard to understand. Even Roger Johansson and Robert Nyman got it wrong and claimed that Webkit and Opera passed the test. I actually wrote to Ian and suggested that he add a visual clue when the "smoothenss" passes or fails. His blog post about what it really means is basically his reply to me. Then came Kimberly Blessing - co-lead of WaSP and said the same thing (sic!), only to be debunked by people from opera and Webkit (in the comments below her post)!
-
-
- Perhaps we should start with the Acid2 test and try to explain that its purpose was actually a challenge to Microsoft to support standards in IE. Of course, it was a challenge to other browsers as well, but the point was not a race or competition, but an effort to get developers of all browsers (especially IE) to cooperate and be interoperable by supporting standards. Acid3 is exactly the same, although we will need to cite a source to specifically state that this same thinking applies to the Acid3 test also. We should try to make it clear that how soon non-IE browsers pass the test is unimportant. How fast Microsoft fixes IE is what's important, as it seems to always be fixed last, it has more users than other browsers, and users of old versions of IE seem to upgrade to the latest versions more slowly than users of other browsers. -- Schapel (talk) 15:24, 11 April 2008 (UTC)
-
[edit] April Acid3 changes
I don't think the latest updates on Acid3 changes are correct. Safari 3.1 still scores 75/100, both when I try it, and also on Browsershots. Opera 9.5 beta 2 scores 78/100 on Browsershots and also according to a forum post and a foreign article. From Hixie's description, likely any browser that scored 100/100 before now scores 99/100, because one test was changed. Let's just mention that Hixie changed the test, and this means that the 100/100 scores reported previously may not be valid, as there was an error in the test. Both pieces of information are correct and verifiable. -- Schapel (talk) 12:19, 25 April 2008 (UTC)
[edit] WebKit r30885 at 88/100 picture?
What's the point of this picture now? Like what the text says, it's already way outdated, and I don't think it serves any encyclopedic purpose now. 61.51.141.65 (talk) 14:46, 3 June 2008 (UTC)
- It serves as an example screenshot to demonstrate the meaning of the various shades of grey and colors. I agree it should be updated. A screenshot of Acid3 in Opera 9.5 seems like it would be the most appropriate, because it's the most used browser that exhibits both shades of grey and a color. Why not grab a screenshot from browsershots and replace it? -- Schapel (talk) 15:56, 3 June 2008 (UTC)
[edit] Mobile Browsers?
Should we add a section regarding the status of mobile browsers in this test? I think some mobile browsers are already doing quite well in this test, for example I think Opera Mobile 9.5 can score over 60/100.
Also now there is an "Acid test" for mobile devices Is your (mobile) browser ready for the Web?, should we have a new entry about mobile browser's standards compliance now? Ufopedia (talk) 07:18, 4 June 2008 (UTC)
- If you have any information regarding the status of mobile browsers, please contribute and be bold. Ghettoblaster (talk) 10:20, 4 June 2008 (UTC)
- well, the thing is I can't find reference sources for them, so it will mostly be original research based on my WM6 smartphone. Ufopedia (talk) 11:49, 4 June 2008 (UTC)
- Uploading screenshots should be okay. Ghettoblaster (talk) 12:08, 4 June 2008 (UTC)
- well, the thing is I can't find reference sources for them, so it will mostly be original research based on my WM6 smartphone. Ufopedia (talk) 11:49, 4 June 2008 (UTC)
- Feel free to create an article on Web Compatibility Test for Mobile Browsers. ffm 16:18, 4 June 2008 (UTC)
[edit] Two issues
[edit] Webkit (most of the time and kind of) passes all critera!
The smoothness bug is now closed: https://bugs.webkit.org/show_bug.cgi?id=17510
A couple of bugs remain, all of which are "it fails sometimes or for some users", i.e. reliabality issues.
I am waiting for an official announcement.
- Yup, I can confirm that the latest WebKit nightly build (r34380) can pass the Acid3 test completely. However there's one interesting thing, according to http://ln.hixie.ch/?start=1207096078&count=1 , the performance aspect is supposed to test the overall speed of the browser. Now the WebKit nightly passes all the sub-tests under 33ms, but its overall speed is actually slower than Opera's gogi build. On my C2D@1.6G rig, WebKit takes around 1.8s to pass the test, while Opera takes only around 1.1s, so now we have a strange situation of a browser passing the performance criteria but is overall slower than another browser who doesn't pass. Ufopedia (talk) 11:11, 8 June 2008 (UTC)
[edit] One test is buggy
Test 7 does not follow the spec. https://bugzilla.mozilla.org/show_bug.cgi?id=433662
Either the test will be fixed - an Opera and Webkit will be back at 99, or the spec will be changed. Mozilla probably won't probably implement to the test, but to the spec (as they should).
Until this issue is settled any claim of "passing" the test is preliminary.
--itpastorn (talk) 08:26, 7 June 2008 (UTC)
[edit] opera 9.5
Opera 9.5 is out now. It's the official version, however note that they didn't include 100% completion in the released version. This build scores 83%. 81.170.222.15 (talk) 08:33, 12 June 2008 (UTC)