Abstract
Introduction
Experiment
Results
Discussion
Conclusions
 
Acknowledgements
References
Appendices
Credits
Feedback
 
PowerPoint presentation
SHORE 2001 : Web

"In Web We Trust": Establishing Strategic Trust Among Online Customers

Authors:
Irina Ceaparu (irina@cs.umd.edu)
Dina Demner (demner@cs.umd.edu)
Edward Hung (ehung@cs.umd.edu)
Haixia Zhao (haixia@cs.umd.edu)

Abstract

Electronic commerce (e-commerce) provides an important chance for established large companies to gain more customers as well as for new small companies to have a good start and rapid growth. Persuading customers to return to an e-commerce site is even more important than attracting them in the first place. Establishing trust between customers and companies through web interface is not as easy as through human-buyer-human-seller interaction. In the past few years, a number of experiments have been conducted in order to determine the factors that influence customers' trust in online businesses. The goal of our experiment was to establish which features that appear on commercial websites are trust-inducing. Our study focused on three independent variables: customer service, testimonial (self and third party) and security features representation (graphics and text). We designed the homepages of eight web sites with different combinations of treatments of the three independent variables. Each of the 52 subjects reviewed all the eight homepages and gave each of them a relative rank of trustworthiness. After the experiment subjects answered additional e-trust related questions. The  results of our experiment and the survey show that all three features that we tested are important in establishing strategic trust among on-line customers. 

Introduction

Background

The fast growth and development of Internet and WWW shows the possibility of a new but important medium of business. Electronic commerce (e-commerce) opens the door for a large variety of businesses including information-technology related ones and old traditional ones. It is an important chance for established large companies to gain more customers as well as for new small companies to have a good start and fast grow.
Through e-commerce, businesses have the opportunity to sell products and services 24 hours a day and to reduce costs associated with personnel and retail space. Also, online businesses have more chances of attracting new customers and having worldwide exposure.
Designing web sites that efficiently present products and easily attract customers is one of the challenges of e-commerce. But selling on the internet is not just creating a web site. Business-to-customer commerce involves interactions and transactions between a company and its consumers. Similar to traditional businesses, it is of great importance for e-commerce not only to attract customers but also to make them come back. Traditional commerce uses catalogs, door-to-door sales people, mail orders and storefronts for their products and services. Unlike traditional stores, online stores use web-based technologies to sell products. A transaction in this case is done between a human and a computer (web) interface.
Although information about different products and vendors is more accessible and orders and payments can be done electronically, customers still have to deal with the buying process. They still have to collect and interpret information, make buying decisions and enter purchase and payment information.

Relevant theories and previous research

To establish trust between customers and companies through web interface is not as easy as through human-buyer-human-seller interaction.
The risks associated with e-commerce can be broadly classified into the following categories:

- business practices – there are several questions that arise: whether a company will really carry out its orders for products and services as it claims or whether there are product guaranties

- information protection – it is important for consumers to have confidence that they have reached a properly identified WWW site, and that the company takes appropriate steps to protect private consumer information.

- translation integrity - potential consumers involved in e-commerce seek assurance that the company has effective transaction integrity controls and a history of processing its transactions accurately, completely, and promptly, and of appropriately billing its consumers.

In the past few years, a number of experiments have been conducted in order to determine the factors that influence customers’ trust in online businesses.
Some researchers indicate that several factors (comprehensive information, shared value and communication) can effectively increase trust, which in turn can increase customer loyalty. [2]
According to Egger’s research [3], trustworthiness often depends upon the strength of a brand name, i.e. its reputation, whether the vendor has a presence off-line or only online. In addition, to increase consumers’ trust in online vendors, consumers should also be informed about the vendor’s privacy policy, e.g. why vendors might require unusual personal details and what happens to confidential information after the transaction. Consumers' judgment of trustworthiness can also be aided by the involvement of truly independent parties. Moreover, a valid legal framework that supports the transaction may also be a determinant of consumers' trust.


In 1998, AT&T Laboratories conducted an experiment [5] designed to determine the nature of online privacy concerns. They established that privacy seals, policies and the type of information disclosed are important factors in online trust. The study was done on a sample of 381 Internet users, and its major findings were:

  • Internet users are more likely to provide information when they are not identified
  • Some types of data are more sensitive than others.
  • Internet users dislike automatic data transfer.
  • A joint program of privacy policies and privacy seals seemingly provides a comparable level of user confidence as that provided by privacy laws.
An empirical study in this field was conducted by Kim and Moon (1998) who investigated which graphic design elements are most likely to communicate trust.
Another e-commerce study was conducted by Cheskin Research and Studio Archetype [6]. Four hundred and sixty three Web users and a wide range of experts in the worlds of e-commerce, Website development and academia contributed to this study. The study determines the elements that communicate trust in e-commerce sites, based on consumer and experts feedback. The 6 fundamental forms to communicate trust are: brand, navigation, fulfillment, presentation, up-to-date technology, seals of approval. Trustworthiness is defined as experience over time (build, confirm and maintain trust).
A second study done by Cheskin Research [7] extends the learning from the initial Trust Study [6] by investigating which are the most recognizable and trusted symbols of online security and by identifying the most trusted websites in the Americas.
Shneiderman establishes in [1] that trust is a positive expectation about the future based on past performance and truthful guarantees and he gives some guidelines on how to establish trust in e-commerce. The following are some important ones:
  • Provide clear guarantee with compensation
  • Get certificates from third parties
  • Provide and enforce privacy and security policy
  • Disclose patterns of past performance
  • Provide references from past and current users
  • Support dispute resolution and mediation services

Current products

Examples of organizations that provide certificates of trust and seals of approval for e-commerce web sites:
  • TRUSTe (www.truste.org) is an independent non-profit organization dedicated to building consumer trust and confidence in the Internet. Their privacy seal program is an online branded seal which is awarded only to sites that adhere to the TRUSTe set of privacy principles for disclosure, access and security.
  • BBBOnline (www.bbbonline.org) is a subsidiary of the Council of Better Business Bureau. Its mission is to promote trust on the Internet through the BBBOnline Reliability and Privacy Seal programs. The first confirms that the company follows good customer service practices and the second confirms that the company stands behind its online privacy policy and has met the program requirements regarding the handling of personal information.
  • Verisign (www.verisign.com) provides through its site trust services a seal of assurance for e-commerce sites that meet disclosure, integrity and protection criteria.
  • WebTrust (www.cpawebtrust.org) is a set of principles and criteria for business-to-consumer e-commerce, developed by the public accounting profession. The WebTrust seal of assurance is a symbolic representation of a practitioner's objective report.
  • Chamber Seal (www.chamberseal.com) provides an online trust seal issued by the Chamber of Commerce. It assures that the holder of the seal is a real and legitimate business with a physical presence at an identifiable location and that this information has been verified by a trusted third party – the local Chamber of Commerce.

Websites

The list includes websites with high and low trustworthiness reputation among online customers:

    1. High trust
    2. www.bbc.com

      www.yahoo.com

      www.barnesandnoble.com

      www.reel.com

    3. Low trust
    4. www.fashionmall.com

                 www.golfweb.com

Experiments

Introduction and hypothesis

Our experiment is designed to determine what features are important in inducing strategic  trust among online customers, which factors will most likely make a B2C e-commerce website trustable and persuasive to the extent that customers will purchase from the website. We hypothesize that in addition to standard usability issues, these three issues will influence trust: extensive customer support, external testimonials and graphical representation of security and privacy policies.
According to our hypothesis the most trusted page is the one containing external testimonial, detailed customer support and contact information, and graphic seals.

Variables

We chose three common strategic trust inducing features from real websites that were not thoroughly studied in  previous experiments, but are considered to be important for an e-commerce site's trustworthiness. The final version (we changed one independent variable according to the pilot study results, see section on pilot study results) of independent and dependent variables are as follows:

Independent variables:

Customer support (2 treatments):
Minimal contact information: only email address is provided.
Maximal contact information: Email address, telephone numbers, real store addresses are provided.

   
Testimonial (2 treatments):
Self-testimonial: the web site provides self-testimonial.
External testimonial: the web site has external testimonial from some well-known magazines and a Feedback Forum.

   
Security features representation (2 treatments):

            

Privacy policy BBB online certified merchant VeriSign Secure site  
Graphics: we used real seals from websites that provide external testimonials and verify site's security, and designed seals for self-testimonials. 
Text: the testimonial is represented as text.

We designed 2 x 2 x 2 = 8 web pages (one of the pages is shown above) with different combinations of treatments of the three independent variables, as shown in the table below:

Page # Customer service Testimonial Seals
1 maximal external graphic
2 maximal external text
3 maximal self text
4 minimal external text
5 maximal self graphic
6 minimal external graphic
7 minimal self graphic
8 minimal self text

Dependent variables:

Relative rank of trustworthiness: each subject estimated trustworthiness of each of the eight web pages on a scale from 1 (least trustworthy) to 9 (most trustworthy). The pages were presented to the subjects in a random sequence, but the subjects could re-visit each page.  Subjects were timed and observed during the evaluation.

Pilot study results

Our original hypothesis stated that customer support, external testimonials and short forms requesting only necessary billing and shipping information are important in inducing trust and was changed based on the results of this study.
We conducted a pilot study on 4 subjects. This small group represented our target test audience, which is college students or graduate students who are comfortable with computers and have been using Internet before the experiment. All subjects were timed and observed when they viewed and ranked the pages. Based on the results of the pilot study, we estimated the amount of time the experiment will take, broken down into stages: 
1. Read the instructions, ask questions, sign Consent Form: ~1 minute 
2. View eight web pages, rank them: ~6 minutes. 
3. Fill out the questionnaire: ~3 minutes
Based on feedback from our subjects and suggestions from Dr. Eric M. Uslaner, we made the following changes and adjustments to our experiment:
We changed the independent variable of Customer Information Filling Form to Security Features Representation, because Customer Information Filling Form was not a factor in web page's trustworthiness. All subjects said they do not care about the filling form because they can always give fake personal information, except for the necessary shipping and billing information. On the other hand, some subjects showed great interest in the security seals on the web pages that we grabbed from the real web sites. They suggested graphic security seals convey trustworthiness of a website. 
In the questionnaire, we removed the items about Customer Information Filling Form, added questions about the style of security features representation, and shortened the questionnaire to make it more related to trust inducing features customers might care about.
We decided to warn subjects that our pages are intentionally similar, because the subjects of the pilot study could hardly see the difference, and thought they were viewing the same page in the beginning.
We rephrased the wording of testimonial and customer support. 
We added privacy policy statement on all the pages.
We removed the horizontal scrolling on each page.

Subjects

We chose subjects who are comfortable with computers and have been using Internet before the experiment. 6 undergraduate and 46 graduate students from the University of Maryland participated in our study. Our subjects consisted of 34 males and 18 females between the ages of 20 to 37. The majority of the subjects are computer science majors. There were also physics, economics, art history, library science, electrical engineering, mathematics, mechanical engineering, French and biochemistry majors.
We conducted a within subjects experiment. No training was required. Prior to the experiment, our subjects were given instructions about the purpose of the experiment, their tasks, and the procedure of experiment. They were given chance to have their questions answered to satisfaction. All subjects signed the consent forms. 

Materials

The following materials were used to conduct the experiment:
  • The simulation of eight commercial web sites based on a WinNT server. The results of the evaluation  were automatically entered into the MSSQL database.
  • Post-experimental questionnaire.
  • Written and oral instructions.

Procedures and problems

The subjects had no special training to participate in our experiment. The subjects were given the instructions and consent forms at the beginning of the experiment. They had their questions about the experiment answered to their satisfaction, and signed the consent forms. Then they were represented with the first web page of the experimental interface that is divided into two frames. The left frame contains links to the eight web pages. Initially the right frame contains the instructions. The order of the eight web pages linked to the eight buttons is randomly initialized when the index page is loaded. When the buttons are clicked, the web page corresponding to the button is shown in the right frame. The subjects clicked the eight buttons to browse the eight web pages, and gave each page a relative trust rank on a scale from 1 (least trustable) to 9 (most trustable) by clicking the radio button in the left frame. They could click the eight buttons in any order they wanted, and could jump back and forward to make changes of ranks. The experiment software recorded the time subjects took to finish ranking, which was from the moment the index page was loaded to the moment the subjects clicked the submit button to indicate they have finished ranking. On submission, the ranks were recorded by the experiment software. Then a short questionnaire asking about subjects' background and opinion about e-commerce web site trustable features showed up. The subjects answered all the questions, clicked the submit button. The software recorded their answers to the questionnaire and brought up an acknowledgement page. The subjects were observed and asked some questions by the observer about their answers to the questionnaire at the end of experiment.

Problems Encountered

We encountered the following problem while conducting our experiment:
When we ran the first 26 subjects, we suspected that some of them did not take the experiment seriously, based on the short time they spent (around 2 minutes) ranking the pages. We recruited 26 more subjects and observed them carefully. Our observations showed that some of them did the evaluation very quickly but still seriously, so we did not discard any subjects.

Results

Our program collected the results of evaluations and the answers to the post-experiment questionnaires into two tables in a MSSQL database. The tables were exported into MS Excel for statistical analysis. (See appendix). We also used VassarStats at http://vassun.vassar.edu/~lowry/VassarStats.htm for 2x2x2 Analysis of Variance.

ANOVA Summary
Source SS df MS F P
A (customer support) 341.66 1 341.66 131.41 <.0001
B (testimonial) 356.31 1 356.31 137.04 <.0001
C (graphical representation) 45.12 1 45.12 17.35 <.0001
AB 20.79 1 20.79 8 <.001
AC 7.27 1 7.27 2.8 0.095
BC 30.69 1 30.69 11.8 <.001
ABC 40 1 40 15.38 <.001
Error 1062.29 408 2.6    
Total 1904.13 415      
The results of the three-way ANOVA using degree of trust as the dependent variable, indicate three main effects of customer support, testimonials and graphical representation. There
was also a Customer Support  x Testimonial interaction, Testimonial x Graphics interaction and a significant interaction between customer support, testimonials and graphical representation. We ran a set of paired t-tests on maximal vs. minimal customer support for pages with external testimonials, as well as for the self testimonials that showed a statistically significant difference in degree of trustworthiness both for the pages containing only textual references to security sites and for the graphically enhanced pages. 
Group mean max-service mean min-service t-statistic P one-tail P two-tail
External testimonial + graphic 7.94 5.33 10.64 <.001 <.001
External testimonial + text 6.38 4.48 6.76 <.001 <.001
Self testimonial + graphic 6.23 4.00 9.60 <.001 <.001
Self testimonial + text 5.25 3.00 8.69 <.001 <.001
Paired t-test for customer support (t-crit one-tail=2.4; t-crit two-tail=2.67)

Similarly t-tests confirmed our hypothesis that external testimonials matter in establishing customers' trust and that trustworthiness of the graphically enhanced pages is greater than the trustworthiness of the text only security references.

The means of trustworthiness ranks and standard deviations for all pages are displayed below:
Means  

 

Standard deviations
  graphic text graphic text
Testimonial Testimonial
  external self external self external self external self
max service 7.94 6.23 6.38 5.25 1.14 1.5 1.66 1.69
min service 5.3 4 4.48 3 1.72 1.56 1.69 1.66

Questionnaire results

Out of 52 subjects 11 buy online more than 10 times a year, 23 buy 3 to 10 times, 15 - 1 to 3 times and 3 students never bought anything online. Only two students are online at least 2-3 times a week, the rest is online every day. 20 of 52 people spend more than 3 hours online; 29 spend 1 to 3 hours and only 3 students spend less than an hour.

All three students that never bought anything online consider security to be a significant factor in their decision. So do other 34 (37 total) people. Only one student does not take the security of the site into consideration while making his 3 to 10 online purchases a year. 14 people list the security feature as a small factor in their decision. We added an average degree of trust for each person obtained in the experiment to the questionnaire results as a dependent variable for statistical analysis. The analysis showed that some of the factors we predicted to be important in establishing trust, are indeed important. The two-sample t-test confirmed the importance of the following features (t critical one-tail=2.4, t critical two-tail=2.7): security and privacy seals; contact number available; clearly stated return policy; possibility to return a purchase at a nearby store; discount or special offers; ease of use of the website; privacy statements. There was no statistically significant difference for other factors.

 

Factor Mean value Standard deviation t-statistic
Security and privacy seals 6.69 1.92 4.75
External testimonials 5.79 1.74 1.63
Contact number available 7.35 1.99 7.00
Being able to visit the real store 5.62 2.43 0.84
Clearly stated return policy 7.37 1.79 7.55
Possibility to return a purchase at a nearby store 6.38 2.47 3.21
Privacy statements 6.21 2.06 3.01
Merchandize type 6.13 2.23 2.59
Discount or special offers 6.60 2.24 4.02
Professional design of the website 5.73 2.15 1.22
Ease of use of the website 6.31 1.95 3.40
 

Some values were very close to critical, for example merchandise type (t =2.59).

Discussion

The goal of our experiment was to establish which features that appear on commercial websites are trust inducing. Previous studies determined that  elements like brand, navigation, fulfillment, presentation, up-to-date technology, seals of approval  communicate trust in e-commerce websites.
Our study focused on customer service, testimonial (self and third party) and security features representation (graphics and text).
Three-way analysis shows that there is interaction between three tested features. Interaction between testimonials and their graphical representation and testimonials and customer support is significant. The analysis of customer service feature showed that extensive customer support is very important. The pages that have extended customer service scored on average 2 points higher than the pages that contained only the email address of the online store. This outcome is supported by the post-experimental questionnaire results which showed that information like contact address and number and clearly stated return policy are a major concern for the customers. These two features scored highest among all decisional factors for online purchases.

The analysis of self and third party testimonial showed that the presence of an external testimonial also contributes to building up trust. Although this proved to be statistically significant in the experiment, in the questionnaire it was not considered to be that significant. 16 out of 52 subjects never heard of the third parties presented in our pages. So there may be other reasons that contribute to this significant difference. According to subjects' feedback one of the reasons may be  the amount of information customers see on the front page of the website - the longer text is visually more convincing. 

The analysis of security features representation showed that graphic seals of approval and graphic security seals induce more trust as opposed to the same information just textually represented. The reason for that may be that visual memory triggers trust without analysis of content. 

The questionnaire the subjects filled after the experiment helped towards a better understanding of the problem. Our expectation was that the mentioning of a real store would add to the credibility of the website. The subjects' feedback show that they do not consider the online store to be an extension of the real store, but rather its convenient replacement. Therefore, details about the real store proved  to be not important.

As opposed to previous studies and our expectations, merchandise type was not a concern for our subjects. The reason for this may be that most of our subjects were computer science students and the websites were selling computers, and they might have assumed that the merchandise type meant brand.

Conclusions

Impact for practitioners

Our experiment shows that all three features that we tested are important in establishing strategic trust among on-line customers. Website designers should include all customer service information available, provide phone numbers for technical support, clearly state the return policy, and provide address for merchandize return. Graphic seals should be included as well as external testimonials, if available.

Suggestions for future research

Our study can be considered as a preliminary investigation into a very interesting topic of on-line trust. Future research should take into consideration the following issues that we came across when running our experiment:

1. We were very careful about the visual impact of colors, size of tables, but we did not take into consideration the length of text. 

2. The source of the external testimonial has to be meaningful to the subjects.

3. The questionnaire should be more specific about the kind of information requested.

4. Because the dependent variable of the experiment is subjective, the number of subjects should be greater, and they should belong to different population groups.