EXAMPLE

Source:

The dataset below contains fictitious tweet information shortly after the release of an application called, "Myco ExampleApp".

Date	twitterId	isEmployee	tweet
11/5/15	lawrencetlu38141	FALSE	Just downloaded Myco ExampleApp! Transforming data in 5 mins!
11/5/15	petramktng024	TRUE	Try Myco ExampleApp, our new free data wrangling app! See www.example.com.
11/5/15	joetri221	TRUE	Proud to announce the release of Myco ExampleApp, the free version of our enterprise product. Check it out at www.example.com.
11/5/15	datadaemon994	FALSE	Great start with Myco ExampleApp. Super easy to use, and actually fun.
11/5/15	99redballoons99	FALSE	Liking this new ExampleApp! Good job, guys!
11/5/15	bigdatadan7182	FALSE	@support, how can I find example datasets for use with your product?

There are two areas of analysis:

For non-employees, you want to know if they are mentioning the new product by name.
For employees, you want to know if they are including cross-references to the web site as part of their tweet.

Transformation:

The following counts the occurrences of the string ExampleApp in the tweet column. Note the use of the ignoreCase parameter to capture capitalization differences:

D trans

RawWrangle	true
p03Value	'ExampleApp'
Type	step
WrangleText	countpattern col:tweet on:'ExampleApp' ignoreCase:true
p01Name	Column
p01Value	tweet
p02Name	Option
p02Value	Text or pattern
p03Name	Text or pattern to count
p04Value	true
p04Name	Ignore case
SearchTerm	Count matches

For non-employees, you want to track if they have mentioned the product in their tweet:

D trans

RawWrangle	true
p03Value	'nonEmployeeExampleAppMentions'
Type	step
WrangleText	derive type:single value:if(isEmployee=='FALSE' && countpattern_tweet=='1',true,false) as:'nonEmployeeExampleAppMentions'
p01Name	Formula type
p01Value	Single row formula
p02Name	Formula
p02Value	if(isEmployee=='FALSE' && countpattern_tweet=='1',true,false)
p03Name	New column name
SearchTerm	New formula

The following counts the occurrences of example.com in their tweets:

D trans

RawWrangle	true
p03Value	'example.com'
Type	step
WrangleText	countpattern col:tweet on:'example.com' ignoreCase:true
p01Name	Column
p01Value	tweet
p02Name	Option
p02Value	Text or pattern
p03Name	Text or pattern to count
p04Value	true
p04Name	Ignore case
SearchTerm	Count matches

For employees, you want to track if they included the above cross-reference in their tweets:

D trans

RawWrangle	true
p03Value	'employeeWebsiteCrossRefs'
Type	step
WrangleText	derive type:single value:if(isEmployee=='TRUE' && countpattern_tweet1 == 1, true, false) as:'employeeWebsiteCrossRefs'
p01Name	Formula type
p01Value	Single row formula
p02Name	Formula
p02Value	if(isEmployee=='TRUE' && countpattern_tweet1 == 1, true, false)
p03Name	New column name
SearchTerm	New formula

Results:

After you delete the two columns tabulating the counts, you end up with the following:

Date	twitterId	isEmployee	tweet	employeeWebsiteCrossRefs	nonEmployeeExampleAppMentions
11/5/15	lawrencetlu38141	FALSE	Just downloaded Myco ExampleApp! Transforming data in 5 mins!	false	true
11/5/15	petramktng024	TRUE	Try Myco ExampleApp, our new free data wrangling app! See www.example.com.	true	false
11/5/15	joetri221	TRUE	Proud to announce the release of Myco ExampleApp, the free version of our enterprise product. Check it out at www.example.com.	true	false
11/5/15	datadaemon994	FALSE	Great start with Myco ExampleApp. Super easy to use, and actually fun.	false	true
11/5/15	99redballoons99	FALSE	Liking this new ExampleApp! Good job, guys!	false	true
11/5/15	bigdatadan7182	FALSE	@support, how can I find example datasets for use with your product?	false	false

Page tree

Versions Compared

Old Version 34

New Version 35

Key