Collection Point for ideas on improving review quality

Subscribe to Collection Point for ideas on improving review quality 10 posts, 6 voices

 
Avatar Avedis_is_back 1280 posts

There are literally tens of threads started and running and spread across the various forum categories – all to do with review quality.
Some contain good ideas, some bad.

Trying to keep track of all the others, especially when the forumites have this penchant for wandering off into general chatting mid thread, is a pain in the butt.

So, first, can I suggest we use this thread as a one stop collection point for those ideas from now on, and with no wandering into general chatting?

Here is my starter:

Main subject – improving those reviews.

Urbis is populated by people, probably representing the main basic variations found in the population as a whole. From the dedicated to the jerks.
Personally, I do not think that there is any scheme that will work to convert the jerks to become dedicated – so forget all reward/penalty concepts.
So, how to help that middle ground population – the ones both willing and able to learn?

Variation is both the ‘spice of life’ and the benefit of Urbis reviews – I personally love that aspect. So, that means I don’t vote for ‘training courses’ or pointing people to ‘top 20 review samples’.

My vote goes for a new and improved ‘review guidelines’, something neat, succinct and covering the essentials. The existing one is just too woolly, long winded and too demanding for the newbies to read and digest. We’ve all had time to learn and I’m sure we can do better now.

Secondary subject – review credits.

I’d like to suggest a parallel improvement in the credit earning algorhythm.
I think that the current method of allocating an initial lump sum based on size of item reviewed encourages fraud. Review a 4000 word item with a single word review – “ whoopee, look at the points I got”.
My suggestion is to use size of item as a factor to be applied as a multiplier for credits per word of the review and with no initial lump sum credited.

e.g. (for demonstration purposes only, not the actual formula I suggest we use – we can all work that out if we agree on the concept):

Item = up to 100 words, factor = 1. 50 word review = 50 credits.
Item = 101 – 1000 words, factor = 2. 50 word review = 100 credits.
Item 1001 – 5000 words, factor = 3. 50 word review = 150 credits.
Item greater than 5001 words, factor = 4. 50 word review = 200 credits.
etc

Still retain the maximum credits limit.

We could also apply another factor based on percent of item read.
e.g.
50 % read, factor = 0.5
so, item length 1000, 50% read, 50 word review gives
50 (length of review) x 2 (factor for item length) x 0.5 (50% read) = 50 credits
etc

Sounds complicated, but the actual maths should be simple to apply to the code.

 
Avatar Curtastrophe 581 posts

Trying to keep track of all the others, especially when the forumites have this penchant for wandering off into general chatting mid thread, is a pain in the butt.

Sooo . . . Anyone heard any good jokes lately? I’ll be on vacation for a week, but I’ll . . . Kidding, Mr. Avedis. Kidding.

Some seriously good points you bring up here. And better yet, solutions. I’ll have to mull these over for a while. Perhaps even bring them up at my next internet addictions meeting—it’s via the web. I hope that Steve and the rest of the “forumites” take these points into consideration as they’re all valid.

O.a. About the chatter thing: It can’t be helped. But it can be stopped if we learn how to block Karma, Jebo, Tnd, Bravis, DC (?), and that annoying Curt guy. (Sorry if I excluded anyone.)

 
Avatar Jebozid 1072 posts

The problem is people DON’T read the review guidelines. They could be slightly improved, but since I read them I haven’t had a single review refunded (and I read them AFTER having my one-and-only-ever review refunded), so they would work if anybody actually would read them. Which people do not.

I do not think your algorithm is improving anything. If I submit a 5000 piece and get a 50-word review, that person would earn 150 credits for reading a huge piece and spending time to understand it, and would be pissed as hell because in that time he could’ve read, let’s say, 20 (minimum) 100-word pieces, made 50-word comments on them, and earned 1000 credits.

I like the -read factor. If he reads only 20 – his review is worth 5 times less than when he would’ve read the whole thing.

 
Avatar Avedis_is_back 1280 posts

Jebozid – do you really see a 50 word review being quality for a 5000 word item? If you love it that much, we are back to just commentary.

 
Avatar Santa_Christ 211 posts

Why not send a message directly to the inbox of any new members who sign up covering all of the review guidelines, possibly with some examples of good/bad reviews? Perhaps they will be more likely to read them if they are sent in a message as opposed to having to click on a link. You could add any other information to this message that you deemed pertinent for first time members as well. Most newbies are probably used to the ego-stroking poetry sites that currently pervade the internet, and may be unaware that this site is different when they first sign up. I would also suggest posting something on the Urbis homepage/user’s homepages specifically stating that the site is strictly based on constructive criticism, as it is not entirely clear when first viewing the site.

 
Avatar Llama Metal 567 posts

My only issue with that, is when I sign up for a new site, if I have a message in the inbox, I immediately delete it. No questions asked. No refunds. No nothing. Just bounce it out of there, because I am a MAN! I don’t need instructions. I don’t need help. I will gladly cut my finger off and use a staple gun to re-attach it.

...

Sorry, Avedis. But, that’s my opinion. If you have an auto-message sent out to new members, chances are that they are just going to delete it.

 
Avatar Karmas A Bitch 856 posts

It might work better than the review guidelines, but as Tnd said, many will just delete it and people tend to ignore instructions. I understand that we are writers and reading is our passion and all of this; but manuals and instruction booklets are completely boring to most and ‘fail to create a hook to keep the reader interested’. ;)

I still have never read the review guidelines. However, I would submit myself to the scrutiny of a review training program because I feel it could be such a beneficial thing, if we can agree on a way to do it.

There is:

1) The review ‘buddy’ idea
2) The special, free review accounts specifically for training purposes
3) The manual (an updated ‘guidelines’)
4) Test reviews
5) The PM of review guidelines (which should be sent attached to refunds)

These all seem like good and diverse ideas. I think there should be a good way to combine and implement them all, either seperately or together, as an effort to help improve the review quality on the site. Any deeper thoughts? Other ideas?

(I can’t believe you are trying to ban me from this thread!! ::pouts and goes away::) ;P

Variation is both the ‘spice of life’ and the benefit of Urbis reviews – I personally love that aspect. So, that means I don’t vote for ‘training courses’ or pointing people to ‘top 20 review samples’.

I agree with this statement wholeheartedly; this is why I recommended that there be more than one person or, at least, more than one way to learn to improve reviews. This way the person who wants to review better, will find their own most comfortable way of reviewing and that they should never be persuaded to go against adding their own personal opinion and touches, because this is what people want: reader’s reactions. I definitely do not think it should be a rigid, one-sided, close-minded sort of ‘this is how it is done, stray and die, Urbisite!’...

 
Avatar Avedis_is_back 1280 posts

tnd:
I never suggested an auto-message. I also said that “I do not think that there is any scheme that will work to convert the jerks ” (Not calling you a jerk here, by the way).

Another simple to implement mechanism would be a trigger in the reviewing routine.
First time review, pop up the guidelines before allowing data entry.
You cannot force a horse to drink – but you can offer it the water.

 
Avatar Llama Metal 567 posts

I’m not a jerk, I am an asshole. But, that’s beside the point.

I think that you and Karma both have good ideas. The review guidelines attached to each refund and having them triggered when posting a review. Though, I would suggest having a fail-safe for the people that have a certain % on their review quality. I.E. If you’ve done over 100 reviews and your review quality is above (say) 75%, then you don’t get the review guidelines popping up every review.

And, we ARE trying to ban you from the thread Karma. We’re scared and intimidated by strong-willed pretty women. I, as a llama, will not succumb to your feminine wiles. But, I will shave my back and make a jacket out of it, as a dowry for my father-in-law.

 
Avatar Jebozid 1072 posts

Hmm, lot of good ideas guys. I’m not even sure which way to go now…
All I’m gonna say is everybody HATES pop-ups. In all forms.
Good luck keeping Karma silent. ::devilishly giggles::