[LTT] Poor testing methodology?

stanlawj

Arch-Supremacy Member
Joined
Jul 11, 2021
Messages
10,016
Reaction score
5,421
I remember watching a recent video from LTT. The amount of asterisk corrections shown on screen was simply ridiculous and made my eyes roll. Can't remember. But it was like a month old video or something.

Just like the previous issue with Asus, again, I am glad that Gamers Nexus is calling out on the erroneous datas that The Labs has been pumping out. It's intentions were to be non-biased and accurate. With that in mind, viewers watching it for reviews and comparison results will take the information at face value. Knowing the high quality that LTT used to produce to get their results and thinking the wrong results now as accurate too unless they check a pinned comment days to even weeks on that same video which is highly unlikely.

Like in the audio world where we have opinionated buffoons and scam artists/snake oil sellers trying to dumb down the audience to not look at the actual graphs from proper testing and make objective testing appear as just another opinion and instead make the audience rely on their very vague and open ended words as the best way to understand a speaker which can result in the audience getting the wrong conclusion of a said product, resulting in actually good speakers and headphones being ignored while bad speakers and headphones are being promoted instead and thus may result in other companies following suit thinking that's what the audience likes, I do not wish to have a reputable company pushing out bad data to consumers and labelling them as objectively accurate; especially when it has not been proof-read.
Remember. Food is subjective. Yet, if you copy the exact cooking method to a T, you will get the same taste every time. That is why there are recipes and cooking guides. Yet, there are subjective ways of cooking where you are made to guess how much salt is needed as opposed to being given the right amount but this method helps no one especially in getting the same results as what the creator has done. No one appreciates bad and unreliable data.

To me, yes, the one on top should be to blame as they are the ones who have the final call to still go ahead and publish the bad data to save cost as seen in GN's video. But at the same time, I've seen people just like the people working at The Labs who tries to cut corners and never check their work before clicking run. Resulting in different game settings for different graphics cards and without anyone checking, thinking the results for those graphics cards are accurate and pushing it to the writers to go through the data and come up with the script on their own conclusion.

Seriously Luke should seriously have been around. His response to Linus's words was of shock that Linus would cut cost and just publish bad data knowingly. Glad to see that Luke has integrity.


At the end of the day, publishing bad data doesn't have any benefit for all parties involved.
-
The audience will get bad conclusions on a product and spend money on a bad product without knowing they were misled. Thus, they've just wasted their money if they realize a correction was made to the video.
- The companies sending the products got bad publicity which may ruin their company especially if they are a small start-up.
- And LTT will lose its audiences' trust significantly over time if they continue down this path.

The problem lies in efficiency of the company. You can't have too much efficiency to the point where people are rushing to get things done as opposed to actually taking the time and care to get a proper review of a product out the window and putting in a correction phase into the mix.

Perhaps they should take a 1 week hiatus to all channels. They will still be making videos but due to the 1 week time gap, most non-time-sensitive projects can be slotted in in the next week's schedule allowing it to have the time to be corrected if any errors were made.
But it could just be that they are limiting 1 video to a certain budget and they might find that spending more on that video is a waste. Thus, they just went with it. I've never had any issues with LTT's old videos. I don't see why they have to do this kind of thing now. It's just disappointing.

Conclusion: If LTT were to take this feedback to improve on their budget allocations, efficiency issues, The Labs laziness to check their work before clicking run on a benchmark, all of us will finally have a better video to look forward to in the future just like how any and all Asus AMD users who had issues finally had a good outcome that came out of the report on Asus's scummy ways in dealing with said issue.
Agree.
Already know that LTT is cutting corners with their data. It is rather obvious to me for quite some time and I watch LTT mainly for entertainment and unique perspectives, but not really too bothered by occasional content problems or unscientific stuff, just some ballpark numbers is good enough for me.
 
Last edited:

stanlawj

Arch-Supremacy Member
Joined
Jul 11, 2021
Messages
10,016
Reaction score
5,421
hm.
https://threadreaderapp.com/thread/1691693740254228741.html^former winner of rog rig reboot turned employee then ex employee
Her sky-high expectation of LMG didn't match the down-to-earth brutal reality that LMG is not a well-oiled corporation led by cool CEO but it is just a garage outfit led by a wonky guy.

That led to her disappointment and complaints instead of working as a team.
IMO, Linus is half-crazy, so I'd be very careful working at LMG. Also Canada is a place where jobs are scarce and low paid for average person. I watched Linus since NCIX days, so I saw the growth and changes, problems and fixes.
 
Last edited:

daisuki

Member
Joined
Jul 29, 2013
Messages
173
Reaction score
47
365790018_2009511776049155_2678680124143603423_n.jpg
 

wtfh4x

Master Member
Joined
Apr 18, 2010
Messages
3,322
Reaction score
210

Again, the same pattern of non-apology.

"Sorry BUT it was only two days delay in response to return the 3090"

"We messed up BUT people shouldn't be so hard on me and call me a thief"

Mark my words, this guy is going to make the same mistake again and it's going to kill his channel for good.
 

wtfh4x

Master Member
Joined
Apr 18, 2010
Messages
3,322
Reaction score
210
Ah one of my favs, people paying to pirate windows. that's crazy :s13:
Not only that, buying from such sites is giving your credit card info to sites which are known to get their keys using, guess what, stolen credit card info.
 

Charlie_Zhan

Supremacy Member
Joined
Nov 17, 2013
Messages
6,577
Reaction score
582


answers given by LMG to Phillip DeFranco. where they covered questions regarding allegations made by Madison Reeve.

Here's the full LMG FAQ that they sent us:

Q: Was the Billet Labs prototype “stolen”?
A: Billet Labs agreed to send us a prototype after we expressed interest in covering the product. Billet Labs agreed to send us the product and said we could keep the prototype instead of returning the product. However, after the release of the video Billet Labs then offered the opportunity to cover a follow up 4090 waterblock, for a future video. Then about 4 days later they requested the return of the block. LMG agreed to return it along with the 3090 Ti.

Q: Why was there a delay in the return of Billet Labs property?
A: The writer of the project handed off the return to another department, but communication was missed. The writer then went on vacation for 2 weeks, returning just before LTX. During this time there was no communication sent from either Billet Labs or LMG. After LTX, upon return to office, the writer followed up with Billet Labs to make sure that they had been sent their property. It was

Q: Why was the prototype block sold?
A: The block was added to a list of products available in a charity auction that was being held at LTX 2023, the company’s fan expo. The goal was to provide unique and rare items for community members to purchase. The prototype ended up being selected, as our internal systems had the item listed as company property, rather than as a return. This was due to a communication error between Billet Labs, the writer of the video, and the procurement team at LMG. The block never should have been part of the auction. (adam)

Q: What are your thoughts on members of the community feeling this initial controversy wasn’t taken seriously due to jokes about store plugs, kicks to sponsores, and the video addressing the situation being monetized?
A: We're LMG. Even when our content is serious, we have elements of fun in it. This has always been our style and we wanted to send a message to our community that just because the suits are talking about workflows and processes, the fun isn't going away. Jokes aside - we have a decade-long unbroken streak of daily videos. To pull back this dramatically I think shows how seriously we're taking community's feedback. We didn't include a sponsor for the video and we heard the feedback from our community and from our team internally and we turned off Adsense monetization for this video.

Q: What is your response to the allegations levied by former employee Madison Reeve and will there be any action taken?
A: We are taking the allegations very seriously. Immediately, our HR team will be conducting a thorough assessment of the allegations. We've already begun combing our personnel files and past notes and correspondences to see if we can corroborate any of what's being said. Furthermore, we will also be hiring an outside investigator to look into the allegations and will commit to publishing the findings and implementing any corrective actions that may arise because of this. When we are ready, we will release a statement. For now, we would ask that we allow our team the time they need be as thorough as possible. As this will take some time and due to our employee confidentiality responsibilities we may not be able to provide a comprehensive statement until we've completed our investigation. We pride ourselves on maintaining a safe and inclusive environment. In addition to our existing report systems (both anonymous and otherwise) we've proactively reached out internally today to encourage members of our team to report any workplace bullying or harassment they might be experiencing so we can take quick and decisive action. We are halting video production and will be reducing our video output in the coming weeks as we strive to provide improvements to processes and work-life balance for our employees.
 

Daty41

Master Member
Joined
Feb 6, 2019
Messages
4,326
Reaction score
1,546
Youtube chanels thinking they are legit tech companies..... I watch for the pure entertaiment and some layman tech advise. Linus always is the goofy the ch guy. Someone more likely to break something than built a PC properly, despite being somehow technically competent. The friend whom its fun to talk tech with but will not trust to help build ur $6k PC system.
 

Phen8210

High Supremacy Member
Joined
Jul 29, 2011
Messages
29,029
Reaction score
8,284
Youtube chanels thinking they are legit tech companies..... I watch for the pure entertaiment and some layman tech advise. Linus always is the goofy the ch guy. Someone more likely to break something than built a PC properly, despite being somehow technically competent. The friend whom its fun to talk tech with but will not trust to help build ur $6k PC system.

He can help you build your 6k PC, but it will become 10K from your pocket.
 

BlackWing1977

Honorary Member
Joined
Mar 1, 2006
Messages
103,361
Reaction score
38,919
Not gonna happen until Linus checks his ego.

When he didn't pay for OCCT and was called out, the response wasn't "we messed up, we'll make it right". It was "here's exactly what I owe and I'm not using your product anymore".

When there was backlash against his expensive backpack with no warranty, the response wasn't "we'll add a warranty", it was "trust me bro".

Now, the response isn't "we made big mistakes", it's "Steve should have approached us first".

His apologies are never "I messed up", it's always some form of "i'm sorry you feel that way, I didn't do anything wrong and it's your fault". It keeps happening so clearly he's not learning from his mistakes.


And this guy also share his personal experience with Linus... apparently he is quite arrogant. :sick:
 

BlackWing1977

Honorary Member
Joined
Mar 1, 2006
Messages
103,361
Reaction score
38,919
LTT just seems like one of those rapidly extending company with poor internal processes and QC.
Yeah... the management like a total mess... and too much pressure to keep pumping videos.. hence reviews are not properly done... and end up a lot errors...
 

BlackWing1977

Honorary Member
Joined
Mar 1, 2006
Messages
103,361
Reaction score
38,919
What's with the name-calling? It sounds personal lol...

Also for the video you linked, the creator harping on ethics is a very ironic situation when he's sponsored and promotes a website that resells keys that are of unverified sources, at best bulk volume license and at worst possibly from illegal methods. Yes, he did say he will stop working with them if proven wrong but I think he got the priority all wrong. The fact that it's ambiguous about the sources of the licenses that they sell makes it MORE unethical and in my opinion, the responsibility is on him to verify when it's been proven that key reseller sites (e.g. G2A) like these do sell keys that comes from straight out illegal sources.
The keys re-selling thing is quite common among the tech YouTube channels.. only the bigger channel get sponsored by bigger companies.. then dun have to earn through that... it comes with it... either that or they got do those mobile games ads... :sick:
 

deepblue_82

Arch-Supremacy Member
Joined
Oct 23, 2007
Messages
19,949
Reaction score
2,474
LTT should cut down... the daily upload + the amount of different ch....
they are called the IT dept of youtube.
closing down ch not possible.
but cut down on the daily update by giving more quality then quantity...
just maybe that would help... then they can spend more time on checking and rechecking each vid b4 upload
 

Ark Law

Arch-Supremacy Member
Joined
Jan 29, 2013
Messages
11,578
Reaction score
540


former anandtech chief reviewer, Dr Cutress speaking hard truths.

didn't watch GN rant video, but will watch this amdk chime in his 2cents :o


Linus - still behaves like a startup CEO while leading a $100M coy
Steve- tries to be objective but presentation wise still isn't objective
Ian - straight up enterprise consultant tier

If one is able to discern personal & business entities and think critically, LMG is just chocked full of operational (and culture) deficiencies, while GN doesn't have that fully objective finesse that their video is subtly implying to have.
 

deepblue_82

Arch-Supremacy Member
Joined
Oct 23, 2007
Messages
19,949
Reaction score
2,474
Linus - still behaves like a startup CEO while leading a $100M coy
Steve- tries to be objective but presentation wise still isn't objective
Ian - straight up enterprise consultant tier

If one is able to discern personal & business entities and think critically, LMG is just chocked full of operational (and culture) deficiencies, while GN doesn't have that fully objective finesse that their video is subtly implying to have.
Linus is or was a "startup CEO"....
lets hope it will get better since he has gotten a 3rd party CEO.
but then again, linus and his wife is still 100% owners of the company so.....
 

Ark Law

Arch-Supremacy Member
Joined
Jan 29, 2013
Messages
11,578
Reaction score
540
Linus is or was a "startup CEO"....
lets hope it will get better since he has gotten a 3rd party CEO.
but then again, linus and his wife is still 100% owners of the company so.....
That's exactly the problem with LMG's structure. CVO officially doesn't have executive powers that the CEO does.

Board of Directors/shareholders are supposed to govern CEO. Which exactly points back to the catch22 you've highlighted. And what many juveniles in the comment sections of videos don't understand.

Even if Linus & Yvonne leave LMG, they still fully own the direction of it.
 

deepblue_82

Arch-Supremacy Member
Joined
Oct 23, 2007
Messages
19,949
Reaction score
2,474
That's exactly the problem with LMG's structure. CVO officially doesn't have executive powers that the CEO does.

Board of Directors/shareholders are supposed to govern CEO. Which exactly points back to the catch22 you've highlighted. And what many juveniles in the comment sections of videos don't understand.

Even if Linus & Yvonne leave LMG, they still fully own the direction of it.
i would not say linus is steve jobs but the idea is similar.
he started the youtube ch and started the company.
well unless if the ppl only ask for linus on diff stuff... and not the direction of the company.
i mean act like a worker then a owner...
if u act like a owner owner... things will not change... if u act like a worker worker owner.. then might go going at a right direction.. real change
 
Important Forum Advisory Note
This forum is moderated by volunteer moderators who will react only to members' feedback on posts. Moderators are not employees or representatives of HWZ Forums. Forum members and moderators are responsible for their own posts. Please refer to our Community Guidelines and Standards and Terms and Conditions for more information.
Top