Guest Post: Surveying Webfiction Feedback

by Isa

Posted by A.M.Harte on Sunday, July 25th, 2010
Isa is a webfiction author as well as the creator of the community-oriented fluffy-seme. She recently conducted a study of online readers and writers and their attitudes towards leaving feedback — in this (lengthy but interesting) post, Isa discusses her results.

So how did this get started?

Some of you, hopefully most of you, may know me as that completely annoying person who runs fluffy-seme.net. A few months ago I had an experience that I found both deeply touching and extremely frustrating: I met a fan of my writing in real life. This person preceded to turn to her friend and spend 15 minutes talking about how totally awesome one of my serials was, taking pauses only to badger her about reading it. Apparently this is not the first time this person has taken it upon herself to be my personal promotion machine.

Here’s the catch: this same fan has never once commented on anything I’ve written. Ever. So despite the willingness to tell everyone else on the planet what she thinks about my work, she has no desire to tell me… at least not in comment form.

At first I found this odd, but then I thought about my past life as a fanfic writer. The pensive cries on every board/community/posting ground since the beginning of time: why aren’t more people commenting on my story?!?! And why aren’t their comments better?

Common sense tells us that people will comment if something is good. If no one is commenting, that’s because no one really likes it. But those of us who’ve been in the reader’s position (basically all of us) probably can think of many things we’ve read, enjoyed and just couldn’t muster words for.

So I went back to fluffy-seme.net and started pitching a new strategy: let’s ditch comments, let’s create a new feedback system that readers will love using instead of one they groan and drag themselves through. Problem is… well unless you’ve actually been in the writing trenches throwing chapter after chapter into a seemingly empty abyss you don’t really appreciate how ill-suited comments are for the world of fiction. “But it works for blogs!” I heard over and over and over again, an assertion I was unable to counter because there simply was no information on internet behavior. It was the last frontier of anthropology and no one had any data at all.

So I decided to collect the data myself.

Purpose of Research:
Survey was conducted to examine the effectiveness of comments as a feedback system for fictional written content published over the internet.

Respondents:
420 people responded to posts on fanficrants, Weblit.us, Web Fiction Guide, Comic Fusion, and Twitter. 54% were from the US, 10.5% from the UK, 7.6% from Canada, 5% from Australia, and the remaining 22.9% were from a variety of other countries. 42.6% of respondents live in major metropolitan areas, 44% of them in suburbs or rural areas (13% could not be determined)

Respondents were asked to identify themselves as readers or writers of online fiction content. 40.9% identified as readers, 18.5% identified as writers, while the remaining 40.6% claimed to do both equally. For my analysis I refer to these groups as “pure readers”, “pure writers” and “mixed” respectively.

Content Types:
The survey looked at four content types specifically and tried to establish patterns of behavior within each group: Fanfiction, Original Fiction (webfiction), Webcomics and Role Plays.

Results:

1. The Readers
Here’s the big news: readers hate commenting.

I figured they would, but frankly I was surprised by the DEGREE that they hate it. The most telling results were the reasons survey respondents filled in themselves: people don’t comment because they don’t want to take the time to, because they’re lazy, because they would rather work their way through all the parts available and comment once than post a comment to each part separately. All of these reasons suggest that readers find commenting an unwelcome chore rather than a fun way to interact with content.

Respondents also highlighted an important reason why comments work for blogs but not for fiction: It seems odd to post a comment on a story that’s old. Comments are real-time reactions while stories — even with live writing, CYOA, and polling games — are essentially static. Comments work for blogs precisely because one does not have to go back to post 1 in order to understand, enjoy and comment upon the most recent update. This is not the case with fiction.

Pure readers have more difficulty expressing themselves than even occasional writers: 49.1% of readers identified this as a major reason for not commenting versus 19.2% of writers and 38% of mixed.

These readers are less likely to respond to guilt or bribery, but more likely to comment if they sympathize with the struggling author: 13.8% would comment if they felt bad for the author where only 2.6% of writers would.

2. The Writers
Pure writers, on the other hand, are natural networkers: 51.3% identified themselves as very likely to comment when they know the author, versus 35.5% of pure readers and 42.7% of mixed. They are also more likely to comment when they are asked by another writer or when they are hoping to get comments on their own work.

Beyond their self interest though, pure writers are a bit more ’survival of the fittest’ than pure readers or mixed: they are less likely to comment to support under-represented genres.

3. Webfiction Readers
In general, webfiction readers are webfiction writers. They were in fact the ONLY group where the majority of respondents identified themselves as writers. For all other content types (except Role Plays), readers outnumber writers 3 to 1. In webfiction there are only about 1.27 readers per writer.

Because webfiction readers are writers themselves, they are more likely than any other group to send a heads up to an author when they spot a typo. They also comment more often: 69% commented on average. Webfiction authors may envy the pull of fanfiction and webcomics, but these formats appear more popular because they attract large numbers of “lurkers” or silent readers who post a comment only once or twice, while webfiction audiences are smaller but more likely to discuss the work with the author in the comments (32.6% versus only 20% of fanfiction readers, 26.5% of webcomic readers and 32.3% of role players).

4. Webfiction Writers
Webfiction writers are dedicated to webfiction. They were the only group that preferred writing something other than fanfiction (73.7% write their own original stories vs. only 48.9% who write fanfiction).

Despite numerous essays on the topic, webfiction writers really are not all that interested in making money off their writing or getting noticed by traditional publishers. They are slightly more likely to find places that can offer these possibilities appealing than writers in other content categories, but their principal concern is exposure, exposure, exposure. Webfiction authors want to be read by people they know in real life and by people they don’t. Most added comments that reflected a more pragmatic approach to the publication of their writing: sure making money and establishing a legitimate publishing career would be nice, but many have promised this dream before and few have delivered. In the end writers understand that the only true path to success is readership.

5. What motivates active commenters?
Interestingly, active commenters are not interested in cultivating discussion about the work (unless they are webfiction readers, in which case they are slightly more interested in it). Their motivation isn’t that different from other commenters: they’ll comment if they love what they’ve read. Therefore, what separates a frequent commenter from an occasional commenter is a willingness to articulate the fact that they would like to read more of the story. Less frequent commenters may feel this way, but they are more comfortable with leaving it unsaid.

Conclusion: What this means for webfiction
A few weeks ago Ergofiction did a couple of series on underrepresented genres in webfiction, echoing an all too common critique: that webfiction is (perhaps unfairly or unrealistically) heavily slanted towards certain genres. Series that cannot be classified as Scifi/Fantasy seem to struggle to find footing with a webfiction audience. While hardly conclusive, I believe these results have shed a little light on exactly why that might be.

Webfiction is an audience filled with rivals. In some ways this — like a large scale writing group — can be an excellent tool to hone talents and receive thoughtful critiques, but in other ways the lack of readers without their own agenda hinders the growth of the format as a whole. As webfiction authors devote themselves to their craft and their own stories and characters, they are less likely to take chances on stories outside of their interests and perhaps (though the research collected no data on this) outside of their personal network of friends within the webfiction community.

Since comments are still the primary mode of feedback through which an author judges her worth, this can make the webfiction community seem clique-y and conformist, even if this is not the case. It can also skew perception of what stories are good, what stories have commercial potential and what genres are appropriate for webfiction at all. One webfiction author noted during the survey that at times it seems that webfiction readers only read series similar to the ones they themselves are writing.

By and large, webfiction authors write because they believe in the story they are creating. While 8.2% of fanfiction authors and 11.9% of role players admitted that they would give up on a story that didn’t get comments, only 6.3% of webfiction writers felt the same way. Webfiction writers are, however, slightly more susceptible to the influence of comments: 83% say they are motivated by them (26.9% of them extremely motivated) and in general webfiction authors agreed with greater frequency that they could figure out what their readers wanted from comments and that their comments were helping them improve as writers.

A few days ago on Novelr I restated my opinion that in order to succeed the webfiction community needs to stop talking to writers and start talking to readers, start bringing in more readers. And aside from the fact that — yes — this is way easier SAID than DONE, one could argue that more writers in more diverse genres would bring in more readers, wouldn’t it?

Except, given what the data shows, feedback and connection with a readership is the most important thing for writers. So recruiting more writers and cultivating more genres without the readership first requires large numbers of extraordinarily stubborn talent who are willing to publish their work as webfiction without any encouragement or acknowledgement from the existing community. And yet what is the alternative? I’ve seen what happens when good intentioned people try to read/review genres and serials they are not interested in: it gets ugly fast and no one benefits.

The summary data of Isa’s survey can be found here and there is also a SPSS file for stat-geeks who may want to play. Isa can be found on twitter as @isakft.

Tags: ,

  • I don't know how I missed this, considering that I filled out the survey, except that my summer has been insane. Thank you so much, Isa, for doing this excellent research. It confirms many things that I have been thinking and noticing myself.
  • This is a fascinating piece of research, thanks for doing it and sharing it. I think there's one more aspect to the problems of lurking and commenting that's not covered here, which is anonymity. I'm a long-term user of LJ and I have two accounts. One is personal, and for years, with the one account, I would read fanfic and only very occasionally comment; only when I thought a piece of work was so good that I'd be happy to admit to anyone who came across my comment and recognised my username that I'd read it. Then I started writing and posting fic with a second account, that's not casually recognisable as me, and that one leaves comments much more readily, is networking and generally putting itself about. I think anonymous feedback mechanisms could be an important factor in the feedback writers get - witness the difference on anonymous kinkmemes and the like. Could be an interesting subject for a further study?
  • I also noticed this myself. Many people wrote in responses about privacy, but as soon as you separated out the original fic people from the fanfic people the frequency of this response went way down. So it still *is* a concern, but it's much less of a concern for original fic readers/writers.

    It will be interesting to see how online publishing reacts to the shifts in internet development that social networking is pushing. I get comments all the time about why the original fluffy-seme integrated with livejournal but not Facebook, why FS will NEVER integrate with FB (lol). Many developers and tech people do not understand that people have different groups of friends and are not willing to share the same information equally among them.
  • Hm, yes, good point. What you say ties in neatly with previous comments about email forms being a popular form of feedback -- people might prefer keeping not only their identity but their comments hidden from the general public.

    Although on many sites it's possible to leave a comment without using your real name or even real email, so readers could easily create another identity for themselves.
  • Meg
    This is an awesome article; thanks for taking the time to compile the data and coax it into a useful bit of information! I had a good time filling out the survey and really enjoyed the breakdown you present here.

    (psst... it's "by and large." See here: http://www.etymonline.com/index.php?term=by )

    And yes, I'm an original fic writer who points out errors and typos. :D
  • LOL. Good on you for spotting the typo. Will fix now. :-)
  • Whoops... this isn't so much a typo as it is my faily-fail ~lol~
  • This is invaluable. Thank you.
  • Comments are a big part of why we do this. It's a unique quality of weblit to be able to receive that instant reaction, and when nobody is saying anything, it's easy to feel like you're just talking to yourself.

    There's a mental hurdle. Most readers aren't used to giving feedback because 20 years ago, nobody could do what we're doing. Gradually, people are changing the way they interact online. 10 years ago, all comments on the web were essentially anonymous, but things like facebook and twitter give us the feeling there's a person on the other side of that screen, and interaction becomes more natural. The disqus box I'm writing in right now is a good step in that direction.

    There are always going to be those who engage passively in what they read, but books can't do we can do, and when people who aren't writers get comfortable with that idea, they're gonna leave us more comments.
  • Funny story: My webfiction site shares a domain name with a forum for people from an MMO guild I played with a few years ago. I didn't think any of the people from the forum would read my stuff; they never seemed like the reading type of people to me. Eventually I got an email from one of them (summary: "hey, you're a writer, cool, I like writing too, we should fight crime") but I figured that was a freak occurrence and unlikely to happen again.

    Two weeks ago, I got asked (in person) about the site by someone who was on the forum. I finally mentioned my writing on the forums, and found out that more people than I thought were reading it! Which is cool, but they really didn't seem to like leaving comments.
  • T.L. Whiteman
    Hm. I get a decent amount of comments, but I think I've only received two or three email comments. However, I do notice that some of the readers I know in real life have never commented on the site, but have told me in person how much they loved an update.

    As for traffic vs. comments, I no longer get discouraged when I don't receive many comments. Anyone that has any sort of stat counter knows whether or not they have readers, and how many. Sometimes its just nice to look and see who has spent hours on your site or who has returned over a dozen times. That means you're being read, even without any comments.
  • Oh yes, but it's very easy to become a stat whore and then worry when your site goes through a slump period! (Who, moi? Noooo.....)
  • T.L. Whiteman
    lol touche
  • Clare K. R. Miller
    Great post, Isa. Thank you for putting all this together. This could be really helpful in the future.
  • Well, I can see it both ways too. As a writer of web fiction, I was more inclined to comment on people's stories that were similar to mine. When I did review exchanges, I was generally uninterested in the stories that people were writing. It's not that they were badly written, they were just not the type of stories I was interested in reading. I was more inclined to comment on someone's thing if they commented on mine.

    So now that I haven't been writing web fiction, but reading it I find that I don't have much to say. I start typing something, then I just stop. It's not that I'm lazy, but I just don't have a lot to say at the end of reading it. I do read it though.
  • Letitia Coyne
    Great article, thanks Isa. I also note a preference for email comments.

    Do you have any ideas or insights into how to bring new readers and writers into the webficton world?
  • I've mentioned this elsewhere, but I think we can do a lot more to bring readers out of the real world. Easily 50% of my regular readers are people I meet offline. At first, that meant close friends and family, but more commonly these days it's people I meet in coffee shops or at poetry events or in libraries. People are generally receptive to the idea, and if you're enthusiastic about your work, they're more likely to want to check it out.
  • Letitia Coyne
    So true. It is important to discuss ways to attract the attention of the swirling webfiction audience. It is also important to realize there is an even bigger audience out there who do not know there is a webfiction community, or webserials, or directories. All writers need to consider new ways to approach that wider readership.
  • I think first it requires writers to work together. I'm a firm believer in multiple serials under one site banner rather than the go-it-alone path ... but otherwise I think breaking down reader skepticism towards webfic may be a matter of building a better feedback platform that more accurately shows a serial's true appeal. As I mentioned in a comment above, there's some research on signaling in decision making, it would not surprise me if many readers passed over webfiction simply because they see no comments and think 'if this was good there would be more readers'
  • Darydith
    "I'm a firm believer in multiple serials under one site banner rather than the go-it-alone path"

    I don't understand why it can't be done both ways. Fanfic writers will publish their work all over the shop, not just on their own sites (assuming they have their own site), so why can't someone update their serial on their own site, and have it syndicated through other 'channels' too?

    Ignoring the questionable legality of it, there are a ton of different manga-reading sites out there. A group releases a scanlation, which they'll have on their own site and also distribute to these other sites. So why can't webserials follow a similar model? You can see it happen with music too - band releases track, track ends up on Last.FM, Youtube, MySpace etc. And TV shows. Pretty much all entertainment media, come to think of it XD
  • It can. I think it depends on your ultimate goals I think. Crossposting would make it practically impossible to monetize (people who believe in donation and ebook sales models will probably argue this point, but this is what I think) and with my fanfiction at least I've found that I tend to receive less feedback the more places it is posted to.

    Maybe others have different experiences with that.
  • Dary
    Impossible to monetize? Surely crossposting would open up to a wider audience, thus potentially increasing merch/ebook sales? It's not like people will stop going to a serial's main site, either, for those worried about losing money through ad revenue - people who read/find it elsewhere may very well have never read/found it otherwise!

    When I posted my serial on FictionPress, I found it was getting more readers/comments than the main site (in the pre-advertising-on-Project-Wonderful days, at any rate). Only reason I stopped posting there was because I hit the hurdle of FP being text only, and I found the majority of readers migrated to the main site anyway.

    But at any rate - if posting a serial on FP only gets you ten new readers, that's ten readers you wouldn't have had otherwise!
  • This is a fantastic article, Isa, and it confirms some of my suspicions. As Becka mentioned above, even blogs have trouble getting comments -- I saw that first-hand when I ran a number of non-writing related blogs.

    I saw something pretty interesting myself recently. I recently disabled comments on GabrielGadfly.com -- comments haven't been available for several weeks, as of this writing. Since doing that, I've seen a marked increase in the number of emails I've received through my contact form. It's a big enough jump that I'm considering whether or not to even include commenting in the newest version of my site.
  • That's odd! You'd think an email would take even more time/effort to fill out; I'm surprised.
  • I thought it was a bit odd at first, but it makes sense, particularly with my genre. The emails I've been getting are a lot more personal than the things people would write in the comments -- I get a lot more feedback about what people are feeling when they read my work, which is pretty important for a poet.
  • Oh it's not surprising to me -- I know we online writers are attention whores by our very nature :D, but there's a quite sizeable number of folks who prefer not to express their thoughts in a public way. I don't have public comments on the page itself (my pages are plain ol' HTML, as I don't use a CMS), but I do have a feedback form/poll after every episode (w/questions specific to that ep) and more people use it than respond in my public forum. Example here: http://bit.ly/bskJ0l
  • On the subject of blogs and commenting let me throw something out there. Blogs have trouble getting comments as well...

    Have a look on point 6 of this... http://www.seomoz.org/blog/21-tactics-to-increase-blog-traffic

    If the figures given there are true then it's no wonder we don't get many comments, most of us don't have 750 unique visitors a day.

  • Many thanks for taking the time to compile all this and perform such thorough analysis, Isa. The results seem quite accurate according to what I've seen/experienced over the past 15 years in webfictiondom -- authors who try to guilt readers into offering feedback, even threatening them with stopping the tale, are spitting in the wind. Though it's perfectly understandable to wish for comments, especially when one's not requiring payment for one's work, readers will comment, or won't, on their own schedule and whims, not ours.

    Your comments about writers/readers wearing genre goggles are particularly pertinent, not to mention timely since we've been having this conversation at a few different places.

    Thanks very much for all your effort in putting this together. Wow!
  • elijames
    If there was a 'like' button on this I would probably click on it a thousand times. =)

    Great job, Isa, this is terrific.
  • capriox bovidae
    Eli, just mentioned something that I think has the potential to be a great supplement for getting feedback - buttons. Shirley Meier has a series of 4 buttons that automatically appear at the bottom of each post for her story "Eclipse Court" hosted on blogspot. The buttons are "horrific,", "hilarious", "curious", and "woot." You can click on those buttons if they represent your reaction, and each post shows how many times a button has been clicked, just like it shows how many comments a chapter has recieved. I love those buttons, because they are so *easy* - one click, no thought - and I can still let Shirley know I read the chapter, and was reacting strongly to it. Not as fine-grained or personalized as comments, but I imagine it certainly beats echoing silence. I don't know if any other of the popular weblit platforms have options like that, but I'd be really interested to see other authors try it and how, if at all, it changes their feedback rate.
  • I'd imagine you could probably emulate that in Drupal using the Flags module pretty easily.
  • Clare K. R. Miller
    Hey, Gabe... where do I find the Flags module? I'd love to get buttons like this on my site.
  • http://drupal.org/project/flag

    It's a pretty robust module; by default it comes with a nifty bookmarking feature, but you can do a lot more with it, especially if you combine it with Rules.

    That said, the big problem I see with using it for feedback buttons is that only registered users can apply flags to content. I'm unaware of a workaround that would allow anonymous users (who are in the majority on any site) to use it.

    Doesn't mean there's not some other module out there that would emulate this feature.
  • One of the voting modules--there are thousands--might work. I'm looking into this myself.
  • capriox bovidae
    ETA: http://eclipsecourt.blogspot.com is the site I'm talking about, if anyone wants to check it out for themselves.
  • This is really interesting because I came to the same conclusion myself a few month ago and I'm currently trying to redevelop fluffy-seme using a system like this but integrating analysis for the writer on the backend so that reactions can be tracked over the course of the serial. I agree it's a much more pleasing system for readers (who I believe despite everything really DO want to support authors)
  • Yeah I've noticed those buttons on blogspot sites, I like them but I don't think there's a WP equivalent....?
  • http://wordpress.org/extend/plugins/reaction-buttons/

    That for self-hosted wordpress blogs. I'm not sure how plugins work for wordpress.com blogs.
  • elijames
    Shouldn't be too hard to code up an equivalent. That said - lemme go take a look at Eclipse Court.
  • Fiona
    Wow, I guess I'm a total oddball in my propensity to comment on web serials, as in so other areas of life. Hey ho!

    The observation about genre struck a chord. The one non-fantasty/sci-fi/supernatural web fiction which I followed from beginning to end, I was the only commenter. Sometimes that felt weird, like maybe it wasn't appropriate to comment. I would have quit, but then I got a response from the author, so I continued. Note: Responses from the author really encourage continued commenting! Commenters can also have that feeling of writing into a void.
  • You know as someone who writes ... "off-genre" lets say, I find I've heard this 'I wasn't sure if it was okay to comment' thing a lot. I think it really goes to show how important signaling is to a story's ability to gather comments in the first place. People will mimic the behavior they see from others around your work.
  • Fiona -- you're awesome. Never stop commenting. :-)
blog comments powered by Disqus